[BEAM-8139] Execute portable Spark application jar - ASF JIRA

XML

Word

Printable

JSON

Details

Type: New Feature
Status: Triage Needed
Priority: P2
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 2.19.0
Component/s: runner-spark
Labels:
- portability-spark

Description

Most of the jar creation code from the Flink implementation can be re-used, but the Spark portable job server will need to be modified, and a Spark-compatible main method will need to be written.

Attachments

Issue Links

blocks

BEAM-8891 Create and submit Spark portable jar in Python

Resolved

BEAM-8970 Spark portable runner supports Yarn

Resolved

is blocked by

BEAM-7966 Write portable Beam application jar

Triage Needed

BEAM-8028 Simplify running of Beam Python on Spark

Resolved

links to

GitHub Pull Request #10287

Activity

People

Assignee:: Kyle Weaver

Reporter:: Kyle Weaver

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Dates

Created:: 03/Sep/19 18:49

Updated:: 13/Apr/23 11:00

Resolved:: 12/Dec/19 17:18

Time Tracking

Estimated:

Not Specified

Remaining:

Logged:

0.5h