Details
-
New Feature
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
Description
We want to retain NM local state store while decommissioning the NM node in a few cases. For example, if there are any auxiliary services(for example external spark shuffle service) running and have created local data then when we decommission and recommission after upgrades, we want to retain the NM local state store so that these services keep serving the earlier data.
This change is about passing a new flag from yarn admin CLI (-deleteState default true) with refreshNodes command to RM, and then sending the same to the NM along with noderefresh response to NM from RM.