Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-11475

Support for a new flag to decide whether to delete or retain the NM local state with a decommission command

    XMLWordPrintableJSON

Details

    Description

      We want to retain NM local state store while decommissioning the NM node in a few cases. For example, if there are any auxiliary services(for example external spark shuffle service) running and have created local data then when we decommission and recommission after upgrades, we want to retain the NM local state store so that these services keep serving the earlier data.

      This change is about passing a new flag from yarn admin CLI (-deleteState default true) with refreshNodes command to RM, and then sending the same to the NM along with noderefresh response to NM from RM.

      Attachments

        Activity

          People

            skalva Sunil Kalva
            skalva Sunil Kalva
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: