Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11694 Über-jira: S3a phase II: robustness, scale and performance
  3. HADOOP-13310

S3A reporting of file group as empty is harmful to compatibility for the shell.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Duplicate
    • None
    • None
    • fs/s3
    • None

    Description

      S3A does not persist group information in file metadata. Instead, it stubs the value of the group to an empty string. Although the JavaDocs for FileStatus#getGroup indicate that empty string is a possible return value, this is likely to cause compatibility problems. Most notably, shell scripts that expect to be able to perform positional parsing on the output of things like hadoop fs -ls will stop working if retargeted from HDFS to S3A.

      Attachments

        Issue Links

          is part of

          Sub-task - The sub-task of the issue HADOOP-12774 s3a should use UGI.getCurrentUser.getShortname() for username

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-14050 Hive attempts to 'chgrp' files on s3a://

          • Major - Major loss of function.
          • Open
          relates to

          Sub-task - The sub-task of the issue HADOOP-12774 s3a should use UGI.getCurrentUser.getShortname() for username

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              cnauroth Chris Nauroth
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: