Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-15806

Update recommended way to shut down detached Yarn session cluster

    XMLWordPrintableJSON

Details

    Description

      When starting a Yarn session cluster in detached mode, then it is printed that one should shut down the cluster via yarn application -kill. The problem of this approach is, however, that temporary files won't be cleaned up which remain on HDFS. Hence, I think a better way would be to reconnect via the yarn-session.sh tool and then to stop the cluster gracefully. This won't leave orphaned files behind.

      Attachments

        Issue Links

          Activity

            People

              trohrmann Till Rohrmann
              trohrmann Till Rohrmann
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m