Bulk Operation

HADOOP-15619 Prune -tombstones to remove children entries

HADOOP-15619 audit/tune s3a authoritative flag in s3guard DDB Table

HADOOP-15619 s3guard bucket info to list a bit more about authoritative paths

HADOOP-15619 ITestDynamoDBMetadataStoreScale fails when throttled.

HADOOP-15619 ITestS3GuardDDBRootOperations. test_100_FilesystemPrune failure

HADOOP-15619 Region must be provided when requesting session credentials or SdkClientException will be thrown

HADOOP-15619 s3guard prune command doesn't get AWS auth chain from FS

HADOOP-15619 Race condition in DDB table init and waiting threads

HADOOP-15619 s3guard auth path checks only check against unqualified source path

HADOOP-15619 Avoid/handle cached 404s during S3A file creation

HADOOP-15619 S3Guard operations log has tombstone/PUT swapped

HADOOP-15619 S3A to warn or fail if S3Guard is disabled

HADOOP-15619 ITestS3GuardDDBRootOperations.test_300_MetastorePrune needs to set region

HADOOP-15619 S3Guard ProgressiveRenameTracker to mark dest dir as authoritative on success

HADOOP-15619 findbugs warning on LocalMetadataStore.ttlTimeProvider sync

HADOOP-15619 S3Guard in auth mode doesn't raise AccessDeniedException on read of 0-byte file

HADOOP-15619 S3Guard: Filter expired entries and tombstones when listing with MetadataStore#listChildren

HADOOP-15619 S3AFilesystem.delete to incrementally update s3guard with deletions

HADOOP-15619 DynamoDBMetaStore deleteSubtree to delete leaf nodes first

HADOOP-15619 ITestS3GuardOutOfBandOperations.deleteAfterTombstoneExpiryOobCreate failure

HADOOP-15619 Transient failure of ITestS3ARemoteFileChanged

HADOOP-15619 mark DynamoDBMetadataStore.deleteTrackingValueMap as final

HADOOP-15619 ITestDynamoDBMetadataStore.testProvisionTable times out intermittently

HADOOP-15619 Hadoop S3Guard Prune command to support a -tombstone option.

HADOOP-15619 S3Guard Diff tool to list+ compare the etag and version fields

HADOOP-15619 S3A: Avoid inconsistencies between DDB and S3

HADOOP-15619 Pass ITtlTimeProvider instance in initialize method in MetadataStore interface

HADOOP-15619 S3A tombstones can confuse empty directory status

HADOOP-15619 ITestS3AMetadataPersistenceException failure

HADOOP-15619 S3A list operation doesn't pick up etags from results

HADOOP-15619 S3Guard table destroy to map IllegalArgumentExceptions to IOEs

HADOOP-15619 S3Guard DDB store prune() doesn't translate AWS exceptions to IOEs

HADOOP-15619 DynamoDBMetadataStore.getVersionMarkerItem() to log at info/warn on retry

HADOOP-15619 "Wrong Billing mode" test failure in ITestS3GuardToolDynamoDB

HADOOP-15619 S3Guard: Remove LocalMetadataStore

HADOOP-15619 S3Guard: Retry failed read with backoff in Authoritative mode when file can be opened

HADOOP-15619 S3Guard: Implement time-based (TTL) expiry for entries (and tombstones)

HADOOP-15619 transient failure of ITestS3GuardToolDynamoDB.testDestroyUnknownTable

HADOOP-15619 Use configurable dynamo table name prefix in S3Guard tests

HADOOP-15619 Add a way to declare a toplevel path in a non-auth FS as auth

HADOOP-15619 S3Guard: fail write that doesn't update metadata store

HADOOP-15619 ITestS3GuardToolDynamoDB test failures

HADOOP-15619 S3Guard: NPE in DynamoDBMetadataStore.lambda$listChildren

HADOOP-15619 S3Guard: Handle OOB deletions and creation of a file which has a tombstone marker

HADOOP-15619 S3Guard to support on-demand DDB tables

HADOOP-15619 S3Guard: use object version or etags to protect against inconsistent read after replace/overwrite

HADOOP-15619 IndexOutOfBoundsException in ITestS3GuardToolLocal

HADOOP-15619 S3Guard: Better support for out-of-band operations

HADOOP-15619 Should be able to set empty directory flag to TRUE in DynamoDBMetadataStore#innerGet when using authoritative directory listings

HADOOP-15619 ITestDynamoDBMetadataStore should check if test ddb table set properly before initializing the test

HADOOP-15619 ITestDynamoDBMetadataStore can leak (large) DDB tables in test failures/timeout

HADOOP-15619 S3Guard testConcurrentTableCreations to set r & w capacity == 0

HADOOP-15619 s3guard init and destroy command will create/destroy tables if ddb.table & region are set

HADOOP-15619 s3guard bucket-info command to not print a stack trace on bucket-not-found

HADOOP-15619 DynamoDB table Update can fail S3A FS init

HADOOP-15619 Intermittent failures of some S3A tests with S3Guard in parallel test runs

HADOOP-15619 NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth S3Guard

HADOOP-15619 ITestS3GuardListConsistency#testConsistentListAfterDelete fails when running with dynamo

HADOOP-15619 ITestS3AEmptyDirectory#testDirectoryBecomesEmpty fails when running with dynamo

HADOOP-15619 LocalMetadataStore put() does not retain isDeleted in parent listing

HADOOP-15619 ClassCastException: S3AFileSystem cannot be cast to MockS3AFileSystem when fs caching is disabled

HADOOP-15619 S3Guard: document how to deal with non-S3Guard processes writing data to S3Guarded buckets

HADOOP-15619 Move S3Guard LocalMetadataStore constants to org.apache.hadoop.fs.s3a.Constants

HADOOP-15619 s3guard set-capacity command to fail fast if bucket is unguarded

HADOOP-15619 S3Guard: Implement time-based (TTL) expiry for Authoritative Directory Listing

HADOOP-15619 s3guard set-capacity to not retry on an access denied exception

HADOOP-15619 S3Guard to support creating on-demand DDB tables

HADOOP-15619 hadoop fs -mkdir -p path-ending-with-slash/ fails with s3guard

HADOOP-15619 s3guard bucket-info will create s3guard table if FS is set to do this automatically

HADOOP-15619 add bulk delete call to metastore API & DDB impl

HADOOP-15619 S3Guard store becomes inconsistent after partial failure of rename

HADOOP-15619 S3Guard: remove "experimental" from documentation

HADOOP-15619 ITestS3GuardTool failures in testDestroyNoBucket()

HADOOP-15619 S3AFileSystem.innerRename() to size metadatastore lists better

HADOOP-15619 s3guard DynamoDB resource not found: tables not ACTIVE state after initial connection

HADOOP-15619 S3Guard: make short-circuit getFileStatus() configurable

HADOOP-15619 S3Guard: DynamoDB can go out of sync with S3AFileSystem.delete()

HADOOP-15619 S3Guard, MetadataStore to support atomic create(path, overwrite=false)

HADOOP-15619 S3Guard: Provide custom FileSystem Statistics.