Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-12260

Graceful Shutdown with In-Memory State

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • DStreams

    Description

      Users often stop and restart their streaming jobs for tasks such as maintenance, software upgrades or even application logic updates. When a job re-starts it should pick up where it left off i.e. any state information that existed when the job stopped should be used as the initial state when the job restarts.

      Attachments

        Activity

          People

            Unassigned Unassigned
            mwws Mao, Wei
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: