Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-9909

Kafka Streams : offset control to Streams API

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 2.5.0
    • None
    • streams
    • All

    Description

      Hello team, really inspired the way streams api is running today. I would like to have a feature to be flexible regarding the offset. when we write the processor api, processor context object can be used to commit the offset. this is not effective. but streams are controlling the offset. the moment the process method executed or scheduled window completed, the offset is committed automatically by streams internally. 

      Like traditional kafka consumer, its better the context object should have complete control over the offset whether to commit or not. This will give more control to the api to handle failovers and especially when message cannot be processed, context should not commit the offset. Appreciate this can be implemented. 

       

      enable.auto.commit is by default false, but streams are committing automatically the offset. 

      Attachments

        Activity

          People

            Unassigned Unassigned
            gopikrishna.chaganti@target.com Gopikrishna
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated: