Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-13097

Don't assume 1 jar on classpath in portable jar creator

Details

    • Bug
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.25.0
    • runner-spark
    • None

    Description

      Right now we assume there is exactly 1 jar, the Spark/Flink job server jar, on the classpath. That assumption is not always correct. We should make this code more flexible, so it works even when there are other jars on the classpath. Perhaps by writing only the specific jar the PortablePipelineJarCreator class came from.

      https://github.com/apache/beam/blob/32dd786f2d6cff02743421c0bb01bd3eea60dbbf/runners/java-job-service/src/main/java/org/apache/beam/runners/jobsubmission/PortablePipelineJarCreator.java#L142

      Attachments

        Issue Links

          Activity

            People

              ibzib Kyle Weaver
              ibzib Kyle Weaver
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: