Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-16829 Über-jira: S3A Hadoop 3.3.1 features
  3. HADOOP-16923

mkdir on s3a should not be sensitive to trailing '/'

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Duplicate
    • None
    • 3.3.0
    • fs/s3
    • None

    Description

      I would have expected to create the directory for both calls:

      [hive@hiveserver2-0 lib]$ hdfs dfs -mkdir s3a://qe-s3-bucket-mst-xfpn-dwx-external/custom-jars2/
      /usr/bin/hdfs: line 4: /usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
      log4j:WARN No appenders could be found for logger (org.apache.hadoop.util.Shell).
      log4j:WARN Please initialize the log4j system properly.
      log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
      mkdir: get on s3a://qe-s3-bucket-mst-xfpn-dwx-external/custom-jars2/: com.amazonaws.services.dynamodbv2.model.AmazonDynamoDBException: One or more parameter values were invalid: An AttributeValue may not contain an empty string (Service: AmazonDynamoDBv2; Status Code: 400; Error Code: ValidationException; Request ID: 1AE0KA2Q5ADI47R75N8BDJE973VV4KQNSO5AEMVJF66Q9ASUAAJG): One or more parameter values were invalid: An AttributeValue may not contain an empty string (Service: AmazonDynamoDBv2; Status Code: 400; Error Code: ValidationException; Request ID: 1AE0KA2Q5ADI47R75N8BDJE973VV4KQNSO5AEMVJF66Q9ASUAAJG)
      [hive@hiveserver2-0 lib]$ hdfs dfs -mkdir s3a://qe-s3-bucket-mst-xfpn-dwx-external/custom-jars2
      /usr/bin/hdfs: line 4: /usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
      log4j:WARN No appenders could be found for logger (org.apache.hadoop.util.Shell).
      log4j:WARN Please initialize the log4j system properly.
      log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
      [hive@hiveserver2-0 lib]$ 
      

      Attachments

        Issue Links

          Activity

            People

              stevel@apache.org Steve Loughran
              kgyrtkirk Zoltan Haindrich
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: