Details
-
Bug
-
Status: In Progress
-
Major
-
Resolution: Unresolved
-
2.3.2, 2.4.0, 3.0.0, 3.1.0
-
None
Description
When launching apps using spark-submit in a kubernetes cluster, if the Spark applications fails (returns exit code = 1 for example), spark-submit will still exit gracefully and return exit code = 0.
This is problematic, since there's no way to know if there's been a problem with the Spark application.