Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-13430 Upgrade Gradle version to 7.3
  3. BEAM-13569

Python postcommit failing portableWordCountSparkRunnerBatch

Details

    • Sub-task
    • Status: Resolved
    • P1
    • Resolution: Fixed
    • None
    • 2.37.0
    • runner-spark, test-failures
    • None

    Description

      Guessing this was due to recent changes such as for the gradle upgrade (BEAM-13430).

      Execution failed for task ':sdks:python:test-suites:portable:py37:portableWordCountSparkRunnerBatch'.

      'Exception in thread "grpc-default-executor-0" java.lang.NoClassDefFoundError: org/apache/spark/streaming/api/java/JavaStreamingListener '
      '\tat org.apache.beam.runners.spark.SparkJobInvoker.createJobInvocation(SparkJobInvoker.java:101)'
      '\tat org.apache.beam.runners.spark.SparkJobInvoker.invokeWithExecutor(SparkJobInvoker.java:82)'
      '\tat org.apache.beam.runners.jobsubmission.JobInvoker.invoke(JobInvoker.java:48)'
      '\tat org.apache.beam.runners.jobsubmission.InMemoryJobService.run(InMemoryJobService.java:246)'
      '\tat org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:948)'
      '\tat org.apache.beam.vendor.grpc.v1p36p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCall s.java:182)'
      '\tat org.apache.beam.vendor.grpc.v1p36p0.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.ja va:35)'
      '\tat org.apache.beam.vendor.grpc.v1p36p0.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)'
      '\tat org.apache.beam.vendor.grpc.v1p36p0.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(Forwarding ServerCallListener.java:40)'
      '\tat org.apache.beam.vendor.grpc.v1p36p0.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)'
      '\tat org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:331)'
      '\tat org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInConte xt(ServerImpl.java:797)'
      '\tat org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)'
      '\tat org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)'
      '\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)'
      '\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)'
      '\tat java.lang.Thread.run(Thread.java:748)'
      'Caused by: java.lang.ClassNotFoundException: org.apache.spark.streaming.api.java.JavaStreamingListener'
      '\tat java.net.URLClassLoader.findClass(URLClassLoader.java:382)'

      Attachments

        Issue Links

          Activity

            People

              ibzib Kyle Weaver
              ibzib Kyle Weaver
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h 20m
                  2h 20m