Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-18477 Über-jira: S3A Hadoop 3.3.9 features
  3. HADOOP-18113

remove filtering of directory markers in s3a RenameOperation

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 3.4.0
    • None
    • fs/s3
    • None

    Description

      S3A RenameOperation tries to filter out renaming intermediate directory markers so as to avoid retaining them when copying from an authoritiative dir to a non-auth one. we did this to support installations where dir marker retention was only enabled for auth dirs

      • nobody, AFAIK, does this..it is all or nothing
      • all recent hadoop releases, including earlier branches, is now marker aware
      • the extras complexity makes debugging rename problems harder.

      let's just cut it out.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: