Details
-
New Feature
-
Status: Patch Available
-
Major
-
Resolution: Unresolved
-
2.7.2
-
None
-
None
Description
I found in all versions of yarn, Speculative Execution may set the speculative task to the node of original task.What i have read is only it will try to have one more task attempt. haven't seen any place mentioning not on same node.It is unreasonable.If the node have some problems lead to tasks execution will be very slow. and then placement the speculative task to same node cannot help the problematic task.
In our cluster (version 2.7.2,2700 nodes),this phenomenon appear almost everyday.
Attachments
Attachments
Issue Links
- duplicates
-
MAPREDUCE-6066 Speculative attempts should not run on the same node as their original attempt
- Resolved