Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-20337

Allow stateful migration from StreamingFileSink to FileSink

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Critical
    • Resolution: Implemented
    • 1.12.0
    • 1.12.0
    • API / DataStream
    • None

    Description

      Flink-1.12 introduces the `FileSink` in FLINK-19510, which can guarantee the exactly once semantics both in the streaming and batch execution mode. We need to provide a way for the user who uses `StreamingFileSink` to migrate from `StreamingFileSink` to `FileSink`.

      For this purpose we propose to let the new sink writer operator could load the previous StreamingFileSink's state and then the `SinkWriter` could have the opertunity to handle the old state. 

       

      Attachments

        Activity

          People

            maguowei Guowei Ma
            maguowei Guowei Ma
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: