Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-55

YARN needs to properly check the NM,AM memory properties in yarn-site.xml and mapred.xml and report errors accordingly.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Invalid
    • 2.0.2-alpha, 0.23.3
    • None
    • resourcemanager
    • CentOs6.0, Hadoop2.0.0 Alpha

    Description

      Please refer to this discussion on the Hadoop Mailing list:
      http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.user/33110

      Summary:
      I was running YARN(Hadoop2.0.0 Alpha) on a 8 datanode, 4 admin node Hadoop/HBase cluster. My datanodes were only having 3.2GB of memory. So, i configured the yarn.nodemanager.resource.memory-mb property in yarn-site.xml to 1200. After setting the property if i run any Yarn Job then the NodemManager wont be able to start any Map task since by default the yarn.app.mapreduce.am.resource.mb property is set to 1500 MB in mapred-site.xml.
      Expected Behavior: NodeManager should give an error if yarn.app.mapreduce.am.resource.mb >= yarn.nodemanager.resource.memory-mb.

      Please let me know if more information is required.

      Attachments

        Activity

          People

            Unassigned Unassigned
            anilgupta84 Anil Gupta
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: