Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-7453

Revert HADOOP-18649

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.3.6
    • 3.4.0
    • mrv2
    • Reviewed

    Description

      Since HADOOP-18649, in container-log4j.properties, log4j.appender.{APPENDER}.MaxFileSize is set to ${yarn.app.container.log.filesize}, but yarn.app.container.log.filesize is 0 in default. So log is missing. This log is always rolling and only show the latest log.

      This is the running log like below:

      Log Type: syslog
Log Upload Time: Fri Sep 08 11:36:09 +0800 2023
Log Length: 0

Log Type: syslog.1
Log Upload Time: Fri Sep 08 11:36:09 +0800 2023
Log Length: 179
2023-09-08 11:31:34,494 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Got an error when resolve hostNames. Falling back to /default-rack for all.  

      Note: log4j.appender.{APPENDER}.MaxFileSize is not set before, then use default value 10M, so no problem before HADOOP-18649

      Attachments

        Issue Links

          Blocked

          Improvement - An improvement or enhancement to an existing feature or task. YARN-11565 Container logs are missing when yarn.app.container.log.filesize is set to default value 0.

          • Major - Major loss of function.
          • Resolved
          is broken by

          Sub-task - The sub-task of the issue HADOOP-18649 CLA and CRLA appenders to be replaced with RFA

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #6042

          Web Link GitHub Pull Request #6102

          Activity

            People

              zhengchenyu Chenyu Zheng
              zhengchenyu Chenyu Zheng
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: