Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-689

When Kafka has topic auto-creation turned on, checkpoint topics may be created w/ wrong partition numbers

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • 0.9.1
    • None
    • container
    • None

    Description

      When Kafka topic auto-creation is turned on in the brokers, a fetch metadata API call will result in topic auto-creation w/ default number of partitions.

      In Samza code, we should always try to create the checkpoint/changelog topic w/ the expected number of partitions first, then call fetch metadata to avoid topic auto-creation creating the topic w/ un-wanted number of partitions.

      Attachments

        Activity

          People

            Unassigned Unassigned
            nickpan47 Yi Pan
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: