Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10902

Resources on application blacklisted node with reserved container can not allocate to other applications

    XMLWordPrintableJSON

Details

    Description

      If a node has reserved container of an application and the application adds this node into its blacklist, resources on the node can not allocate to other applications in the current allocation process.
      In RegularContainerAllocator, if it finds the node is in blacklist, it will not allocate resources. Furthermore, this node has a reserved container, other queues or application will not have opportunity to allocate.

      ContainerAllocation tryAllocateOnNode(Resource clusterResource,
          FiCaSchedulerNode node, SchedulingMode schedulingMode,
          ResourceLimits resourceLimits, SchedulerRequestKey schedulerKey,
          RMContainer reservedContainer) {
        ContainerAllocation result;
      
        // Sanity checks before assigning to this node
        result = checkIfNodeBlackListed(node, schedulerKey);
        if (null != result) {
          return result;
        }
        // ....
      }

      In this case, the reserved container should be cancelled. 

       

      Attachments

        Issue Links

          Activity

            People

              jackwangcs jackwangcs
              jackwangcs jackwangcs
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m