Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-13611

CrossLanguageJdbcIOTest.test_xlang_jdbc_write failing in Python PostCommits

Details

    • Bug
    • Status: Resolved
    • P1
    • Resolution: Fixed
    • None
    • 2.36.0
    • test-failures

    Description

      apache_beam.io.external.xlang_jdbcio_it_test.CrossLanguageJdbcIOTest.test_xlang_jdbc_write has been failing for a while with exception:

      >       raise self._runtime_exception
      E       RuntimeError: Pipeline BeamApp-jenkins-0107121045-d4c26ca6_6fb3ef1a-9704-4c9b-8e6a-b01577324d10 failed in state FAILED: java.lang.RuntimeException: Error received from SDK harness for instruction 3: org.apache.beam.sdk.util.UserCodeException: org.apache.beam.sdk.coders.CoderException: cannot encode a null Iterable
      E       	at org.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:39)
      E       	at org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1751)
      E       	at org.apache.beam.fn.harness.FnApiDoFnRunner.access$2700(FnApiDoFnRunner.java:144)
      E       	at org.apache.beam.fn.harness.FnApiDoFnRunner$FinishBundleArgumentProvider$Context.output(FnApiDoFnRunner.java:2078)
      E       	at org.apache.beam.sdk.io.jdbc.JdbcIO$1.finish(JdbcIO.java:1459)
      E       	at org.apache.beam.sdk.io.jdbc.JdbcIO$1$DoFnInvoker.invokeFinishBundle(Unknown Source)
      E       	at org.apache.beam.fn.harness.FnApiDoFnRunner.finishBundle(FnApiDoFnRunner.java:1729)
      E       	at org.apache.beam.fn.harness.data.PTransformFunctionRegistry.lambda$register$0(PTransformFunctionRegistry.java:111)
      E       	at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:489)
      E       	at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:151)
      E       	at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:116)
      E       	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      E       	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      E       	at java.lang.Thread.run(Thread.java:748)
      E       Caused by: org.apache.beam.sdk.coders.CoderException: cannot encode a null Iterable
      E       	at org.apache.beam.sdk.coders.IterableLikeCoder.registerByteSizeObserver(IterableLikeCoder.java:195)
      E       	at org.apache.beam.sdk.coders.IterableLikeCoder.registerByteSizeObserver(IterableLikeCoder.java:60)
      E       	at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$SampleByteSizeDistribution.tryUpdate(PCollectionConsumerRegistry.java:374)
      E       	at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:248)
      E       	at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:209)
      

      First failure in Py3.8 PostCommit was #2110 but this actually had a different error. The first failure with this exception was #2130

      Attachments

        Issue Links

          Activity

            People

              pabloem Pablo Estrada
              bhulette Brian Hulette
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 10m
                  1h 10m