[HBASE-18084] Improve CleanerChore to clean from directory which consumes more disk space - ASF JIRA

Voters

Stop watching

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 2.0.0
Component/s: None
Labels:
None

Hadoop Flags:

Reviewed

Description

Currently CleanerChore cleans the directory in dictionary order, rather than from the directory with largest space usage. And when data abnormally accumulated to some huge volume in archive directory, the cleaning speed might not be enough.

This proposal is another improvement working together with ~~HBASE-18083~~ to resolve our online issue (archive dir consumed more than 1.8PB SSD space)