Details
-
Bug
-
Status: Resolved
-
P2
-
Resolution: Fixed
-
None
-
None
Description
Right now we assume there is exactly 1 jar, the Spark/Flink job server jar, on the classpath. That assumption is not always correct. We should make this code more flexible, so it works even when there are other jars on the classpath. Perhaps by writing only the specific jar the PortablePipelineJarCreator class came from.
Attachments
Issue Links
- blocks
-
BEAM-8970 Spark portable runner supports Yarn
- Resolved