Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-431 [Umbrella] Complete/Stabilize YARN application log-handling
  3. YARN-1111

NM containerlogs servlet can't handle logs of more than a GB

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Minor
    • Resolution: Won't Fix
    • 2.1.0-beta
    • 2.6.0
    • nodemanager
    • None

    • Long-lived service generating lots of log data from HBase running in debug level

    Description

      If a container is set up to log stdout to a file, the container log servlet will list the file

      err.txt : Total file length is 551 bytes.
out.txt : Total file length is 1572099246 bytes.

      If you actually click on out.txt then the tail logic takes a very long time to react. There is also the question of what will happen if the log fills up that volume

      Attachments

        Issue Links

          is depended upon by

          New Feature - A new feature of the product, which has yet to be developed. YARN-896 Roll up for long-lived services in YARN

          • Major - Major loss of function.
          • Open
          is related to

          Sub-task - The sub-task of the issue YARN-173 Page navigation support for container logs page and the logs web-service on NMs

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. YARN-2082 Support for alternative log aggregation mechanism

          • Major - Major loss of function.
          • Open

          Task - A task that needs to be done. SLIDER-116 Log handling for long-lived applications

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue YARN-1104 NMs to support rolling logs of stdout & stderr

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue YARN-2468 Log handling for LRS

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: