Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-3144

No need to set "spark.local.dir" in ExecutorLauncher

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.0.2
    • 1.1.0
    • YARN
    • None

    Description

      ExecutorLauncher only will be lanched in Yarn-Client mode as a simple Application Master.
      In this process, it would not create the spark.local.dir since Spark driver or executor will not be launched in it.
      So it may delete such code.

      Attachments

        Activity

          People

            joshrosen Josh Rosen
            carlmartin Zhaowei Huang
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: