Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11694 Über-jira: S3a phase II: robustness, scale and performance
  3. HADOOP-13275

hadoop fs command path doesn't include translation of amazon client exceptions

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Invalid
    • 2.8.0
    • None
    • fs/s3
    • None

    Description

      If you try to do unauthed write operations to an s3a repo, the failure can surface without the AmazonClientException being translated

      bin/hadoop fs -D fs.s3a.aws.credentials.provider=org.apache.hadoop.fs.s3a.AnonymousAWSCredentialsProvider -rm s3a://landsat-pds/scene_list.gz
16/06/15 14:03:32 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
16/06/15 14:03:35 INFO Configuration.deprecation: io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
rm: s3a://landsat-pds/scene_list.gz: delete on s3a://landsat-pds/scene_list.gz: com.amazonaws.services.s3.model.AmazonS3Exception: Access Denied (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request ID: 0F2954E98D193227), S3 Extended Request ID: hpGyx9Snazi71vqxJcsLTr054aUO3+wu9fBEGgjbx0y41nMF6Xj5oyA+P9/0G6A6H93BsOtrDuM=

      Attachments

        Activity

          People

            stevel@apache.org Steve Loughran
            stevel@apache.org Steve Loughran
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: