Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-5786

KafkaIO should support topic patterns

Details

    • Improvement
    • Status: Open
    • P3
    • Resolution: Unresolved
    • None
    • None
    • io-java-kafka
    • None

    Description

      For the moment, it is possible to set topics for KafkaIO.Read in 2 ways - one single topic by using withTopic(String) or list of topics by using withTopics(List<String>).

      It would make sense to provide another way for this using patterns, based on regular expressions, like withTopics(“org_[0-9]+_source”). In this case, Kafka consumer could discover the topics based on user provided pattern.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              aromanenko Alexey Romanenko
              Votes:
              2 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated: