Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5397 [Umbrella] Usability improvements in FairScheduler
  3. YARN-4911

Bad placement policy in FairScheduler causes the RM to crash

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      When you have a fair-scheduler.xml with the rule:

      <queuePlacementPolicy>
      <rule name="default" queue="okay1" create="false" />
      </queuePlacementPolicy>

      and the queue okay1 doesn't exist, the following exception occurs in the RM:

      2016-04-01 16:56:33,383 FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error in handling event type APP_ADDED to the scheduler
      java.lang.IllegalStateException: Should have applied a rule before reaching here
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.QueuePlacementPolicy.assignAppToQueue(QueuePlacementPolicy.java:173)
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.assignToQueue(FairScheduler.java:728)
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.addApplication(FairScheduler.java:634)
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:1224)
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:112)
      at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher$EventProcessor.run(ResourceManager.java:691)
      at java.lang.Thread.run(Thread.java:745)

      which causes the RM to crash.

      Attachments

        1. YARN-4911.001.patch
          1 kB
          Ray Chiang
        2. YARN-4911.002.patch
          3 kB
          Ray Chiang
        3. YARN-4911.003.patch
          5 kB
          Ray Chiang
        4. YARN-4911.004.patch
          5 kB
          Ray Chiang

        Activity

          People

            rchiang Ray Chiang
            rchiang Ray Chiang
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: