Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3946

If a resource requirement is higher than available on any node, job should fail early

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 0.23.2, 2.0.0-alpha
    • None
    • resourcemanager
    • None

    Description

      If you configure the NMs to have 1GB of RAM each, and then try to submit a job which has an AM resource requirement of 1.5GB, the job will neither run nor fail. Instead, it will slowly sop of all of the resources in the cluster as "reservations" despite the fact that it will never be able to schedule something. Instead, it should fail early indicating that the required memory allocation is infeasible.

      Attachments

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. YARN-193 Scheduler.normalizeRequest does not account for allocation requests that exceed maximumAllocation limits

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. YARN-56 Handle container requests that request more resources than currently available in the cluster

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: