Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-18728

ABFS handles nonexistent/non-auth accounts badly

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.3.5
    • None
    • fs/azure
    • None

    Description

      Testing storediag with a nonexistent account/bucket raises interesting failures modes

      1. DNS failures are retried, rather than fail fast
      2. a container which exists but you can't access fails with the wrong exception
      org.apache.hadoop.fs.FileAlreadyExistsException: Operation failed: "This endpoint does not support BlobStorageEvents or SoftDelete. Please disable these account features if you would like to use this endpoint.", 409, HEAD, https://somewhere.dfs.core.windows
      
      

      Proposed

      1. failfast on host not found, escalate to an account not found
      2. recognise and translate that does not support BlobStorageEvents

      side issue: is that failure leaking secrets about another a/c? or is it always raised if not authed

      Attachments

        Activity

          People

            Unassigned Unassigned
            stevel@apache.org Steve Loughran
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: