Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-12673

apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT.test_streaming_wordcount_it flakey

Details

    • Bug
    • Status: Open
    • P1
    • Resolution: Unresolved
    • None
    • None
    • test-failures

    Description

      The test failed twice because another Dataflow job already existed with the same name.

      (Are we running multiple occurrences of the test at the same time, and using the timestamp to generate the name? If so, Occasionally the same timestamp will be picked twice)

      The workflow could not be created. Causes: (a8f47b4f3654731d): There is already an active job named beamapp-jenkins-0728180349-027689. If you want to submit a second job, try again by setting a different name."

      https://ci-beam.apache.org/job/beam_PreCommit_Python_Commit/19388/

      Both fail with this error:

      def __ProcessHttpResponse(self, method_config, http_response, request): """Process the given http response.""" if http_response.status_code not in (http_client.OK, http_client.CREATED, http_client.NO_CONTENT): raise exceptions.HttpError.FromResponse( > http_response, method_config=method_config, request=request) E apitools.base.py.exceptions.HttpConflictError: HttpError accessing <

      https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json

      >: response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 'application/json; charset=UTF-8', 'date': 'Wed, 28 Jul 2021 18:05:03 GMT', 'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 'transfer-encoding': 'chunked', 'status': '409', 'content-length': '318', '-content-encoding': 'gzip'}>, content <{ E "error":

      { E "code": 409, E "message": "(1ddd3f68174d9490): The workflow could not be created. Causes: (a8f47b4f3654731d): There is already an active job named beamapp-jenkins-0728180349-027689. If you want to submit a second job, try again by setting a different name.", E "status": "ALREADY_EXISTS" E }

      E } E >

      Run 1:

      https://ci-beam.apache.org/job/beam_PreCommit_Python_Commit/19388/testReport/junit/apache_beam.examples.streaming_wordcount_it_test/StreamingWordCountIT/test_streaming_wordcount_it/

       

      Run 2

      https://ci-beam.apache.org/job/beam_PreCommit_Python_Commit/19388/testReport/junit/apache_beam.examples.streaming_wordcount_it_test/StreamingWordCountIT/test_streaming_wordcount_it_2/

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              ajamato@google.com Alex Amato
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: