Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-36623 Improve spark exit logic
  3. SPARK-42698

Client mode submit task client should keep same exitcode with AM

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: In Progress
    • Major
    • Resolution: Unresolved
    • 3.5.0
    • None
    • YARN
    • None

    Description

      ```
      try

      { app.start(childArgs.toArray, sparkConf) }

      catch

      { case t: Throwable => throw findCause(t) }

      finally {
      if (!isShell(args.primaryResource) && !isSqlShell(args.mainClass) &&
      !isThriftServer(args.mainClass)) {
      try

      { SparkContext.getActive.foreach(_.stop()) }

      catch

      { case e: Throwable => logError(s"Failed to close SparkContext: $e") }

      }
      }
      }
      ```

      Attachments

        Activity

          People

            Unassigned Unassigned
            angerszhuuu angerszhu
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: