Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6524

Avoid storing unnecessary information in the Memory for the finished apps

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 2.7.3
    • None
    • RM
    • None

    Description

      Avoid storing unnecessary information in the Memory for the finished apps
      In case of cluster with large number of finished apps, more memory is required to store the unused information i.e. related AM's Container launch like Localization resources, tokens etc.
      In one such scenario we had around 9k finished apps each with 257 LocalResource amounting to 108 kbytes per app and just for 9k apps it was nearly taking ~ 0.8 GB of memory. In Low end machines this would create resource crunch in RM

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              Naganarasimha Naganarasimha G R
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: