Uploaded image for project: 'Jackrabbit Oak'
  1. Jackrabbit Oak
  2. OAK-10634

Generalise Split segment store persistence

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • segment-tar
    • None

    Description

      Introduced with OAK-7735,

      Split segment store persistence is a proxy layer that can be used between the SegmentMK and the actual segment store persistence. It's configured with two backends: read-only and read-write. It delegates all the read requests to the read-only backend, but any write request (eg. creating a new segment) is delegated to the read-write backend.

      It would be nice to have a generalisation of Split segment store service allowing the composition of multiple read-only backends and a single read-write backend.

      The main advantage is that we can have multiple segment stores in the cloud (using the oak-segment-azure), shared amongst many Oak instances, starting dynamically.

      The implementation remembers the state (tar file list, last journal entry) of the read-only backends during its initialisation, so the read-only backend can be used by a different instance, as long as it only appends new segments (e.g. no compaction).

      Attachments

        Activity

          People

            adulceanu Andrei Dulceanu
            adulceanu Andrei Dulceanu
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: