Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-11387

Kafka performance test is failing

Details

    Description

      Kafka performance tests are failing due to "outside-X" service port allocation in kubernetes setup.

      I confirmed it's not caused by Kafka clients version update from 1.0.0 to 2.4.1.

      Logs from example failing job [1]:
      07:28:23 job.batch/kafka-config-eff079ec created
      07:28:23 Error from server (Invalid): error when creating "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Kafka_IO/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-0.yml": Service "outside-0" is invalid: spec.ports[0].nodePort: Invalid value: 32400: provided port is already allocated
      07:28:23 Error from server (Invalid): error when creating "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Kafka_IO/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-1.yml": Service "outside-1" is invalid: spec.ports[0].nodePort: Invalid value: 32401: provided port is already allocated
      07:28:23 Error from server (Invalid): error when creating "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Kafka_IO/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-2.yml": Service "outside-2" is invalid: spec.ports[0].nodePort: Invalid value: 32402: provided port is already allocated
      07:28:23 Build step 'Execute shell' marked build as failure

      [1] https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/1636/console

      Attachments

        Activity

          People

            Unassigned Unassigned
            piotr-szuberski Piotr Szuberski
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: