[OAK-4279] Rework offline compaction - ASF JIRA

Attach files

Attach Screenshot

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Task
Status: Closed
Priority: Blocker
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 1.5.3, Segment Tar 0.0.2, 1.6.0
Component/s: segment-tar
Labels:
- compaction
- gc

Epic Link:
Segment Tar

Description

The fix for ~~OAK-3348~~ broke some of the previous functionality of offline compaction:

No more progress logging
Compaction is not interruptible any more (in the sense of ~~OAK-3290~~)
Offline compaction could remove the ids of the segment node states to squeeze out some extra space. Those are only needed for later generations generated via online compaction.

We should probably implement offline compaction again through a dedicated Compactor class as it was done in oak-segment instead of relying on the de-duplication cache (aka online compaction).