Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-42880

Improve the yarn document for lo4j2 configuration

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Trivial
    • Resolution: Fixed
    • 3.3.2
    • 3.5.0
    • Documentation, Spark Core, YARN
    • None

    Description

      Since Spark3.3 has changed log4j1 to log4j2, some documents should also be updated. 

      For example, docs/running-on-yarn.md still uses log4j1 syntax as follows.

      `log4j.appender.file_appender.File=${spark.yarn.app.container.log.dir}/spark.log`. 

      Attachments

        Activity

          People

            zhifgli Zhifang Li
            zhifgli Zhifang Li
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: