Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8839

Failed ValidatesRunner tests for new Spark Runner

    XMLWordPrintableJSON

Details

    Description

      Some of the transform translations for new Spark runner (Flatten and Combine in particular) fail on several corner cases when ValidatesRunner tests are running. These tests were excluded from run for new Spark Runner to keep Jenkins job green and detect regression easily (if any) but they have to be addressed and correspondent translations have to be fixed.

      List of these tests:

       'org.apache.beam.sdk.transforms.CombineFnsTest.testComposedCombineWithContext'
 'org.apache.beam.sdk.transforms.CombineTest$CombineWithContextTests.testSimpleCombineWithContext'
 'org.apache.beam.sdk.transforms.CombineTest$CombineWithContextTests.testSimpleCombineWithContextEmpty'
 'org.apache.beam.sdk.transforms.CombineTest$WindowingTests.testFixedWindowsCombineWithContext'
 'org.apache.beam.sdk.transforms.CombineTest$WindowingTests.testSessionsCombineWithContext'
 'org.apache.beam.sdk.transforms.CombineTest$WindowingTests.testSlidingWindowsCombineWithContext'
 'org.apache.beam.sdk.transforms.FlattenTest.testEmptyFlattenAsSideInput'
 'org.apache.beam.sdk.transforms.FlattenTest.testFlattenMultipleCoders'
 'org.apache.beam.sdk.transforms.FlattenTest.testFlattenPCollectionsEmpty'
 'org.apache.beam.sdk.transforms.FlattenTest.testFlattenPCollectionsEmptyThenParDo'
 'org.apache.beam.sdk.transforms.SplittableDoFnTest.testLifecycleMethodsBounded'

      Attachments

        Activity

          People

            Unassigned Unassigned
            aromanenko Alexey Romanenko
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: