Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-41550 Dynamic Allocation on K8S GA
  3. SPARK-42357

Log `exitCode` when `SparkContext.stop` starts

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0
    • 3.4.0
    • Spark Core
    • None

    Description

      23/02/06 02:12:55 INFO SparkContext: SparkContext is stopping with exitCode 0.
      
      Pi is roughly 3.147080
      23/02/06 02:12:55 INFO SparkContext: SparkContext is stopping with exitCode 0.
      ...
      23/02/06 02:12:55 INFO AbstractConnector: Stopped Spark@1cb72b8{HTTP/1.1, (http/1.1)}{localhost:4040}
      23/02/06 02:12:55 INFO SparkUI: Stopped Spark web UI at http://localhost:4040
      23/02/06 02:12:55 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
      23/02/06 02:12:55 INFO MemoryStore: MemoryStore cleared
      23/02/06 02:12:55 INFO BlockManager: BlockManager stopped
      23/02/06 02:12:55 INFO BlockManagerMaster: BlockManagerMaster stopped
      23/02/06 02:12:55 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
      23/02/06 02:12:55 INFO SparkContext: Successfully stopped SparkContext
      23/02/06 02:12:56 INFO ShutdownHookManager: Shutdown hook called
      

      Attachments

        Activity

          People

            dongjoon Dongjoon Hyun
            dongjoon Dongjoon Hyun
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: