Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8938

Tests end up leaving stale Dataflow jobs in apache-beam-testing project and exhaust GCP resources

Details

    • Bug
    • Status: Resolved
    • P0
    • Resolution: Not A Problem
    • None
    • Not applicable
    • testing
    • None

    Description

      Some tests (I'm not sure if this is the exhaustive list but they seem to appear in the dataflow console repeatedly) that seem to not be killed and eat our resources: 
       - test_reshuffle_preserves_timestamps (spotted multiple times in the dataflow console) (Python SDK)
       - test_flatten_same_pcollections (Python SDK)
       - testPairWithIndexWindowedTimestampedBounded (Java SDK)

       -  testPairWithIndexBasicBounded (Java SDK)
       
      Temporary solution is to ignore them. Real solution requires greater investigation.

      Please see the devlist thread for more context: https://lists.apache.org/thread.html/01eb33ae9c05d12bb0698f91adc0021662fdfe2978cfdfde28dc56b2%40%3Cdev.beam.apache.org%3E

      Attachments

        Issue Links

          Activity

            People

              kamilwu Kamil Wasilewski
              ŁukaszG Lukasz Gajowy
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 50m
                  1h 50m

                  Slack

                    Issue deployment