Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-26365

spark-submit for k8s cluster doesn't propagate exit code

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      When launching apps using spark-submit in a kubernetes cluster, if the Spark applications fails (returns exit code = 1 for example), spark-submit will still exit gracefully and return exit code = 0.

      This is problematic, since there's no way to know if there's been a problem with the Spark application.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            oscar.bonilla Oscar Bonilla

            Dates

              Created:
              Updated:

              Slack

                Issue deployment