Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13345 S3Guard: Improved Consistency for S3A
  3. HADOOP-13452

S3Guard: Implement access policy for intra-client consistency with in-memory metadata store.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • HADOOP-13345
    • fs/s3
    • None

    Description

      Implement an S3A access policy based on an in-memory metadata store. This can provide consistency within the same client without needing to integrate with an external system.

      Attachments

        1. HADOOP-13452-HADOOP-13345.003.patch
          18 kB
          Aaron Fabbri
        2. HADOOP-13452-HADOOP-13345.002.patch
          18 kB
          Aaron Fabbri
        3. HADOOP-13452.001.patch
          11 kB
          Aaron Fabbri

        Issue Links

          is depended upon by

          Sub-task - The sub-task of the issue HADOOP-13631 S3Guard: implement move() for LocalMetadataStore, add unit tests

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue HADOOP-12876 [Azure Data Lake] Support for process level FileStatus cache to optimize GetFileStatus frequent operations

          • Major - Major loss of function.
          • Resolved
          requires

          Sub-task - The sub-task of the issue HADOOP-13448 S3Guard: Define MetadataStore interface.

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-13447 Refactor S3AFileSystem to support introduction of separate metadata repository and tests.

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              fabbri Aaron Fabbri
              cnauroth Chris Nauroth
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: