Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2653

dynamic map slots (in addition to predifined) on each node which allows to execute cpu intensive jobs along with memory intensive jobs thereby reducing wastage of cpu cycles

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.20.203.0
    • None
    • jobtracker, tasktracker
    • linux

    • dynamic map slots

    Description

      I have introduced process monitoring system inside tasktracker, which analyses the cpu and memory utilization of each map task and allows me to increase/decrease maximum number of map slots dynamically on each node. With this I can combine cpu intensive jobs along with memory intensive jobs, thereby reducing the cpu idle time.

      Attachments

        Activity

          People

            Unassigned Unassigned
            nandan.samant nandan
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - 672h
                672h
                Remaining:
                Remaining Estimate - 672h
                672h
                Logged:
                Time Spent - Not Specified
                Not Specified