Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-3578

Multithreaded commitlog

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Low
    • Resolution: Fixed
    • 2.1 beta1
    • None

    Description

      Brian Aker pointed out a while ago that allowing multiple threads to modify the commitlog simultaneously (reserving space for each with a CAS first, the way we do in the SlabAllocator.Region.allocate) can improve performance, since you're not bottlenecking on a single thread to do all the copying and CRC computation.

      Now that we use mmap'd CommitLog segments (CASSANDRA-3411) this becomes doable.

      (moved from CASSANDRA-622, which was getting a bit muddled.)

      Attachments

        1. parallel_commit_log_2.patch
          40 kB
          Piotr Kolaczkowski
        2. 0001-CASSANDRA-3578.patch
          91 kB
          Michaël Figuière
        3. ComitlogStress.java
          3 kB
          Vijay
        4. Current-CL.png
          189 kB
          Vijay
        5. Multi-Threded-CL.png
          173 kB
          Vijay
        6. latency.svg
          467 kB
          Benedict Elliott Smith
        7. oprate.svg
          7 kB
          Benedict Elliott Smith
        8. TestEA.java
          2 kB
          Benedict Elliott Smith
        9. 3578-logging-v2.txt
          4 kB
          Jonathan Ellis
        10. 3578-logging-v3.txt
          4 kB
          Jonathan Ellis

        Issue Links

          Activity

            People

              benedict Benedict Elliott Smith
              jbellis Jonathan Ellis
              Benedict Elliott Smith
              Jonathan Ellis
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: