Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-20161

Default log4j properties file should print thread-id in ConversionPattern

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • 2.1.0
    • None
    • Deploy, Spark Core, YARN
    • None

    Description

      The default log4j file in spark/conf/log4j.properties.template doesn't display the thread-id when printing out the logs. It would be very useful to add this, especially for YARN. Currently, logs from all the different threads in a single executor are sent to the same log file. This makes debugging difficult as it is hard to filter out what logs come from what thread.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              stakiar Sahil Takiar
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: