Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-18477 Über-jira: S3A Hadoop 3.3.9 features
  3. HADOOP-14707

AbstractContractDistCpTest to test attr preservation with -p, verify blobstores downgrade

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.9.0
    • None
    • fs, fs/azure, fs/s3, test, tools/distcp
    • None

    Description

      It may be that trying to use distcp -p with S3a triggers a stack trace 

      java.lang.UnsupportedOperationException: S3AFileSystem doesn't support getXAttrs 
at org.apache.hadoop.fs.FileSystem.getXAttrs(FileSystem.java:2559) 
at org.apache.hadoop.tools.util.DistCpUtils.toCopyListingFileStatus(DistCpUtils.java:322)

      Add a test to AbstractContractDistCpTest to verify that this is handled better. What is "handle better" here? Either ignore the option or fail with "don't do that" text

      Attachments

        1. HADOOP-14707-001.patch
          3 kB
          Steve Loughran
        2. HADOOP-14707-002.patch
          16 kB
          Steve Loughran
        3. HADOOP-14707-003.patch
          21 kB
          Steve Loughran

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-15691 Add PathCapabilities to FS and FC to complement StreamCapabilities

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              stevel@apache.org Steve Loughran
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: