Details
-
Sub-task
-
Status: Open
-
Major
-
Resolution: Unresolved
-
3.3.5
-
None
Description
iceberg and hbase could benefit from being able to give a list of individual files to delete -files which may be scattered round the bucket for better read peformance.
Add some new optional interface for an object store which allows a caller to submit a list of paths to files to delete, where
the expectation is
- if a path is a file: delete
- if a path is a dir, outcome undefined
For s3 that'd let us build these into DeleteRequest objects, and submit, without any probes first.
Attachments
Issue Links
- is related to
-
HADOOP-18722 Optimise S3A delete objects when multiObjectDelete is disabled
- Open
- relates to
-
HADOOP-18420 Optimise S3A’s recursive delete to drop successful S3 keys on retry of S3 DeleteObjects
- Open
- links to
(2 links to)