Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3767

Yarn Scheduler Load Simulator does not work

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • 2.7.0
    • None
    • None
    • None
    • OS X 10.10. JDK 1.7

    Description

      Running the SLS, as per the instructions on the web results in a NullPointerException being thrown.

      Steps followed to create error:

      1) Download Apache Hadoop 2.7.0 tarball from Apache site
      2) Untar 2.7.0 tarball into /opt directory
      3) Execute the following command:

      /opt/hadoop-2.7.0/share/hadoop/tools/sls//bin/slsrun.sh --input-rumen=/opt/hadoop-2.7.0/share/hadoop/tools/sls/sample-data/2jobs2min-rumen-jh.json --output-dir=/tmp

      Results in the following error:

      15/06/04 10:25:41 INFO rmnode.RMNodeImpl: a2118.smile.com:2 Node Transitioned from NEW to RUNNING
      15/06/04 10:25:41 INFO capacity.CapacityScheduler: Added node a2118.smile.com:2 clusterResource: <memory:30720, vCores:30>
      15/06/04 10:25:41 INFO util.RackResolver: Resolved a2115.smile.com to /default-rack
      15/06/04 10:25:41 INFO resourcemanager.ResourceTrackerService: NodeManager from node a2115.smile.com(cmPort: 3 httpPort: 80) registered with capability: <memory:10240, vCores:10>, assigned nodeId a2115.smile.com:3
      15/06/04 10:25:41 INFO rmnode.RMNodeImpl: a2115.smile.com:3 Node Transitioned from NEW to RUNNING
      15/06/04 10:25:41 INFO capacity.CapacityScheduler: Added node a2115.smile.com:3 clusterResource: <memory:40960, vCores:40>
      Exception in thread "main" java.lang.RuntimeException: java.lang.NullPointerException
      at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:134)
      at org.apache.hadoop.yarn.sls.SLSRunner.startAMFromRumenTraces(SLSRunner.java:398)
      at org.apache.hadoop.yarn.sls.SLSRunner.startAM(SLSRunner.java:250)
      at org.apache.hadoop.yarn.sls.SLSRunner.start(SLSRunner.java:145)
      at org.apache.hadoop.yarn.sls.SLSRunner.main(SLSRunner.java:528)
      Caused by: java.lang.NullPointerException
      at java.util.concurrent.ConcurrentHashMap.hash(ConcurrentHashMap.java:333)
      at java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:988)
      at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:126)
      ... 4 more

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              dkjerrumgaard David Kjerrumgaard
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: