Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-9754

Trogdor workloads fail because topics are not fully created when workloads start.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • system tests
    • None

    Description

      In many instances, when running with high partition counts, trogdor ProduceBench workloads have been failing with the following error:

      This server does not host this topic-partition. 

      This is caused by the test not checking that the topic is fully created before starting to produce to it.

      As far as I see it, there are 2 options here:

      1. Check the topic status at the beginning of the test and wait for the topic to be in a healthy state.
      2. Add exception handling around the SendRecords call to allow for ignoring these failures and continuing.

      #2 would be easier than #1, however they both have trade-offs.

      Attachments

        Issue Links

          Activity

            People

              scott.hendricks Scott Hendricks
              scott.hendricks Scott Hendricks
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: