Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-10430

Hook support

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      Currently big data storage (like HDFS and HBASE) allows other tooling to hook into it, for instance atlas.

      As data movement tools become more open to Kafka as well, it makes sense to shift significant amounts of storage to Kafka, for instance when one just needs a buffer.

      However, this may be blocked due to governance constraints. As currently producers and consumers would need to actively make an effort to log governance (where something like HDFS can guarantee its capture).

      Hence I believe we should make it possible to hook into kafka as well so one does not simply depend on the integrity of the producers and consumers.

      Attachments

        Activity

          People

            viktorsomogyi Viktor Somogyi-Vass
            DennisJaheruddin Dennis Jaheruddin
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: