Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-45717

Avoid use spark.yarn.user.classpath.first

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 3.5.0
    • None
    • YARN

    Description

      When we set spark.yarn.user.classpath.first=true, we get the following message

       

      23/10/30 14:32:16.855 pool-1-thread-1-ScalaTest-running-ClientSuite WARN SparkConf: The configuration key 'spark.yarn.user.classpath.first' has been deprecated as of Spark 1.3 and may be removed in the future. Please use spark.{driver,executor}.userClassPathFirst instead. 

       
       

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              dzcxzl dzcxzl
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: