Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-34255

FLIP-406: Reorganize State & Checkpointing & Recovery Configuration

    XMLWordPrintableJSON

Details

    Description

      The FLIP: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=284789560

       

      Currently, the configuration options pertaining to checkpointing, recovery, and state management are primarily grouped under the following prefixes:

      • state.backend.* : configurations related to state accessing and checkpointing, as well as specific options for individual state backends
      • execution.checkpointing.* : configurations associated with checkpoint execution and recovery
      • execution.savepoint.{*}: configurations for recovery from savepoint

      In addition, there are several individual options such as state.checkpoint-storage and state.checkpoints.dir that fall outside of these prefixes. The current arrangement of these options, which span multiple modules, is somewhat haphazard and lacks a systematic structure. For example, the options under the {{CheckpointingOptions }}and {{ExecutionCheckpointingOptions }}are related and have no clear boundaries from the user's perspective, but there is no unified prefix for them. With the upcoming release of Flink 2.0, we have an excellent opportunity to overhaul and restructure the configurations related to checkpointing, recovery, and state management. This FLIP proposes to reorganize these settings, making it more coherent by module, which would significantly lower the barriers for understanding and reduce the development costs moving forward.

      Attachments

        Issue Links

          Activity

            People

              zakelly Zakelly Lan
              zakelly Zakelly Lan
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: