Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-19596

IntervalTree build throughput is low enough to be a bottleneck

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Normal
    • Resolution: Unresolved
    • 5.x
    • None
    • Performance
    • Low Hanging Fruit
    • All
    • None
    • Hide

      Existing units tests + a new QT based test

      Show
      Existing units tests + a new QT based test

    Description

      With several terabytes of data and 8 compactors it’s possible for the compactors to spend a lot of time blocked waiting on IntervalTrees to be built.

      There is also a lot of wasted CPU because it’s updated optimistically so most of them end up being thrown away.

      This can end up being quite painful because it can block memtable flushing as well and then a single slow CFS can block unrelated CFS because the memtable post flush executor is single threaded and shared across all CFS.

      Attachments

        1. ci_summary.html
          51 kB
          Ariel Weisberg

        Issue Links

          Activity

            People

              aweisberg Ariel Weisberg
              aweisberg Ariel Weisberg
              Ariel Weisberg
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: