Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-11300

[Umbrella] Extract and refactor queue resource calculation + Add a generic way to explain calculations in the logs

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      Queue resource calculations are not centralised, scattered through many classes and a source of dozens of bugs. We need a common place to store these calculations, simplify them if possible and extend it with proper logging.
      Example of such calculations:
      AbstractLeafQueue#assignContainers
      AbstractCSQueue#accept
      AbstractLeafQueue#calculateAndGetAMResourceLimitPerPartition
      AbstractLeafQueue#updateMaximumApplications
      ... and many more.

      Attachments

        Issue Links

          Dependent

          Sub-task - The sub-task of the issue YARN-10965 Centralize queue resource calculation based on CapacityVectors

          • Major - Major loss of function.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. YARN-10888 [Umbrella] New capacity modes for CS

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              groot Ashutosh Gupta
              quapaw András Győri
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: