Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2003

It should be able to specify different jvm settings for map and reduce child process (via mapred.child.map.java.opts and mapred.child.reduce.java.opts options)

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • None
    • 0.20.3, 0.21.0, 0.22.0
    • tasktracker
    • None

    Description

      Sometimes mapper child process requires different JVM settings than reducer. For example when mapper requires much more memory than reducer.
      Now it's only possible to set options for both using mapred.child.java.opts.

      Proposed solution: mapred.child.java.opts could be overwritten by mapred.child.map.java.opts or mapred.child.reduce.java.opts. Thus, we're adding more flexibility and compatibility with old configurations.

      The same should be done for mapred.child.env.

      Attachments

        Activity

          People

            Unassigned Unassigned
            klimontovich Vladimir Klimontovich
            Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: