Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-18886 S3A: AWS SDK V2 Migration: stabilization and S3Express
  3. HADOOP-19072

S3A: expand optimisations on stores with "fs.s3a.create.performance"

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.4.0
    • None
    • fs/s3

    Description

      on an s3a store with fs.s3a.create.performance set, speed up other operations

      • mkdir to skip parent directory check: just do a HEAD to see if there's a file at the target location

      Attachments

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-19161 S3A: option "fs.s3a.performance.flags" to take list of performance flags

          • Major - Major loss of function.
          • Open
          links to

          Web Link GitHub Pull Request #6543

          Activity

            People

              vjasani Viraj Jasani
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: