Uploaded image for project: 'Apache YuniKorn'
  1. Apache YuniKorn
  2. YUNIKORN-876

Optimize scheduler memory consumption

    XMLWordPrintableJSON

Details

    Description

      On a cluster with about 500 nodes, we've seen the memory consumption goes over 12GB. This is not optimal. Using http://yunikorn.apache.org/docs/next/performance/profiling#memory-profiling, we got the memory footprint dump as attached in the JIRA. We need to optimize resource consumption and reduce the memory usage.

      Attachments

        1. profile001.pdf
          205 kB
          Weiwei Yang
        2. YUNIKORN-876-0.12-WIP.2.patch
          24 kB
          Craig Condit
        3. YUNIKORN-876-0.12-WIP.3.patch
          25 kB
          Craig Condit
        4. YUNIKORN-876-0.12-WIP.patch
          24 kB
          Craig Condit

        Issue Links

          Activity

            People

              ccondit Craig Condit
              wwei Weiwei Yang
              Votes:
              1 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: