Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
The MR AM is now in a great position to reuse containers across (map) tasks. This is something similar to JVM re-use we had in 0.20.x, but in a significantly better manner:
- Consider data-locality when re-using containers
- Consider the new shuffle - ensure that reduces fetch output of the whole container at once (i.e. all maps) : MAPREDUCE-4525
Attachments
Attachments
Issue Links
- is blocked by
-
YARN-75 RMContainer should handle a RELEASE event while RUNNING
- Closed
- is related to
-
MAPREDUCE-4525 Combiner per node
- Open
- relates to
-
MAPREDUCE-4596 Split StateMachine state from states seen by MRClientProtocol (for Job, Task, TaskAttempt)
- Closed