Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-10091

Support for CDCR using an external queueing service

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • CDCR

    Description

      The idea is to contribute part of the work presented here:
      https://www.youtube.com/watch?v=83vbY9f3nXA

      Specifically these components:

      • update processor that writes updates to an external queueing service (abstracted by an interface)
      • a Kafka implementation of this interface (that goes into /contrib?) so anyone using kafka can use this "out of the box"
      • a consumer application

      For the consumer application, the idea is an app that's queue-agnostic and then the queue-specific consumer bit is loaded at runtime. In this case, there's a "default" kafka consumer in there as well.

      I'm not exactly sure what the best structure would be for these pieces (the kafka implementations and the general consumer app code), so I'll simply post class definitions here and let the community decide where they should go.

      The core work is finished. I just need to clean it up a bit and convert the tests to fit this repo (right now they're using an external framework).

      Attachments

        Activity

          People

            Unassigned Unassigned
            obates Oliver Bates
            Votes:
            2 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated: