Uploaded image for project: 'Apache Whirr (retired)'
  1. Apache Whirr (retired)
  2. WHIRR-710

Whirr launch for CDH4 MRv1 using deprecated mapred.child.java.opts property

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.8.1
    • None
    • service/hadoop
    • Ubuntu (EC2)

    Description

      Launching the cluster with the following properties, will install CDH4.2.0 MRv1 in all the nodes.
      whirr.hadoop.install-function=install_cdh_hadoop
      whirr.hadoop.configure-function=configure_cdh_hadoop
      whirr.env.REPO=cdh4

      However, after the launch of the cluster, the deprecated property, mapred.child.java.opts is set with default value as below,in mapred-site.xml
      <property>
      <name>mapred.child.java.opts</name>
      <value>-Xmx550m</value>
      </property>

      To be used as :
      mapred.(map|reduce).child.java.opts ie. mapred.map.child.java.opts and mapred.reduce.child.java.opts

      To reproduce the error:
      Running the map task or reduce task, more than the default heap size, creates OOME

      Attachments

        Activity

          People

            Unassigned Unassigned
            swathimystery Swathi V
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: