Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-14011

Multi threaded L0 -> L1 compaction

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Normal
    • Resolution: Unresolved
    • 5.x
    • Local/Compaction
    • None

    Description

      Currently L0 -> L1 compactions are almost always single threaded because every L0 sstable will overlap with all L1 sstables. To improve this, we should range-split the input sstables in a configurable amount of parts and then use multiple threads to write out the results. This is similar to the max_subcompactions option in RocksDB: https://github.com/facebook/rocksdb/wiki/Leveled-Compaction

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              marcuse Marcus Eriksson
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated: