Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-11697

Improve Compaction Throughput

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Normal
    • Resolution: Unresolved
    • None
    • Local/Compaction
    • None

    Description

      The goal of this ticket is to improve/understand the bottlenecks during compactions. At a high level this will involve:

      • A test system for measuring compaction time for different workloads and compaction strategies.
      • Profiling and analysis
      • Make improvements
      • Add throughput regression tests so we can track

      We have a lot of random tickets that relate to this so I'll link them to this ticket

      Attachments

        1. image.png
          9 kB
          T Jake Luciani

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. CASSANDRA-11599 When there are a large number of small repaired L0 sstables, compaction is very slow

          • Normal -
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. CASSANDRA-12366 Fix compaction throttle

          • Normal -
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. CASSANDRA-9259 Bulk Reading from Cassandra

          • Urgent - This issue should block release until it is resolved, and trigger immediate release once resolved.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. CASSANDRA-10805 Additional Compaction Logging

          • Low -
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. CASSANDRA-8731 Optimise merges involving multiple clustering columns

          • Normal -
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. CASSANDRA-8906 Experiment with optimizing partition merging when we can prove that some sources don't overlap

          • Low -
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. CASSANDRA-8923 Improve MergeIterator performance for binary prefix comparable data

          • Low -
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. CASSANDRA-10309 Avoid always looking up column type

          • Low -
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. CASSANDRA-9766 Faster Streaming

          • Normal -
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. CASSANDRA-11623 Compactions w/ Short Rows Spending Time in getOnDiskFilePointer

          • Low -
          • Resolved

          Activity

            People

              tjake T Jake Luciani
              tjake T Jake Luciani
              T Jake Luciani
              Votes:
              1 Vote for this issue
              Watchers:
              21 Start watching this issue

              Dates

                Created:
                Updated: