Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8193

Python PostCommit Tests are Flaky

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: Not applicable
    • Component/s: sdk-py-core, testing
    • Labels:
      None

      Description

      I will use this as an umbrella bug, create sub task and assign to folks working on Python in general. I will try to do a round-robin assignment.

      The goal is to improve stability of Py2, 3.5, 3.6, 3.7 postcommits to be working >80% of the time [1].

      /cc (you might get issues assigned) Pablo Estrada Udi Meiri Chamikara Madhusanka Jayalath Valentyn Tymofieiev

      [1] http://104.154.241.245/d/McTAiu0ik/stability-critical-jobs-status?orgId=1

        Attachments

        1.
        virtualSetupEnv task is flaky Sub-task Open Valentyn Tymofieiev  
        2.
        Quota exceeded for create requests Sub-task Resolved Yifan Zou  
        3.
        Python Post Commit 3.6 issue Sub-task Resolved Chad Dombrova  
        4.
        Python 3.{5,7} post commit timed out at 100 minutes Sub-task Resolved Valentyn Tymofieiev

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 40m
        5.
        test_big_query_write_without_schema might be flaky? Sub-task Open Pablo Estrada  
        6.
        Python pre-commits need to include python 3.x tests Sub-task Closed Valentyn Tymofieiev  
        7.
        Run Portable_Python PreCommit fails with pickling Sub-task Closed Valentyn Tymofieiev  
        8.
        Use persistent caching with pip Sub-task Open Kyle Weaver  
        9.
        Py2 post-commit test crossLanguagePortableWordCount failing Sub-task Closed Chamikara Madhusanka Jayalath

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 2h
        10.
        ZipFileArtifactServiceTest.test_concurrent_requests flaky Sub-task Resolved Robert Bradshaw

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 2h 10m
        11.
        docker-credential-gcloud missing Sub-task Closed Unassigned  
        12.
        test_streaming_pipeline_returns_expected_user_metrics_fnapi_it test flaky Sub-task Resolved Valentyn Tymofieiev  
        13.
        installGcpTest task is flaky Sub-task Closed Udi Meiri  
        14.
        Consistently timing out: BigQueryStreamingInsertTransformIntegrationTests.test_multiple_destinations_transform Sub-task Resolved Pablo Estrada

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 2h 20m
        15.
        BigQueryQueryToTableIT.test_big_query_legacy_sql - fails in post commit tests Sub-task Open Chamikara Madhusanka Jayalath  
        16.
        portableWordCountFlinkRunnerStreaming - flaky post commits Sub-task Open Kyle Weaver  
        17.
        sparkValidatesRunner - python post commit flaky Sub-task Resolved Kyle Weaver  
        18.
        BigQueryWriteIntegrationTests.test_big_query_write_without_schema - flaky post commit Sub-task Resolved Chamikara Madhusanka Jayalath  
        19.
        beam_PostCommit_Py_VR_Dataflow is timing out Sub-task Resolved Valentyn Tymofieiev

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 40m
        20.
        PreCommit_Python2_PVR_Flink_Commit flaky Sub-task Open Kyle Weaver  
        21.
        beam_PostCommit_Py_ValCont should run with dataflow_worker_jar Sub-task Open Valentyn Tymofieiev  

          Activity

            People

            • Assignee:
              altay Ahmet Altay
              Reporter:
              altay Ahmet Altay
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 7h 50m
                7h 50m