Uploaded image for project: 'Jackrabbit Oak'
  1. Jackrabbit Oak
  2. OAK-4015

Expedite commits from the compactor

    XMLWordPrintableJSON

Details

    Description

      Concurrent commits during compaction cause those to be re-compacted. Currently it seems that the compaction thread can end up waiting for some time to acquire the commit lock [1], which in turn causes more commits to pile up to be re-compacted. I think this could be improved by tweaking the lock such that the compactor could jump ahead of the queue. I.e. use a lock which can be acquired in expedited mode.

      [1] SegmentNodeStore#commitSemaphore

      Attachments

        1. OAK-4015.m
          5 kB
          Michael Dürig
        2. OAK-4015.pdf
          28 kB
          Michael Dürig
        3. OAK-4015-histo.png
          13 kB
          Michael Dürig
        4. OAK-4015-wait-time.png
          210 kB
          Michael Dürig

        Issue Links

          depends upon

          New Feature - A new feature of the product, which has yet to be developed. OAK-4122 Replace the commit semaphore in the segment node store with a scheduler

          • Major - Major loss of function.
          • Closed
          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. OAK-4256 CLONE - Cross gc sessions might introduce references to pre-compacted segments

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. OAK-3348 Cross gc sessions might introduce references to pre-compacted segments

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              mduerig Michael Dürig
              mduerig Michael Dürig
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: