Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-13852

KafkaIO.read.withDynamicRead() doesn't pick up new TopicPartitions

Details

    • Bug
    • Status: In Progress
    • P1
    • Resolution: Unresolved
    • None
    • None
    • io-java-kafka
    • None

    Description

      KafkaIO.Read().withDynamicRead() is correctly pulling messages from existing topics, but isn't picking up new topics or partitions when they are created.

      Currently, this appears to be an interaction between the timer configuration, and the duration of the operating window, that is causing the problem

      Attachments

        Activity

          People

            johnjcasey John Casey
            johnjcasey John Casey
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated: