Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-1456

Make UnboundedSourceWrapper snapshot to rescalable operator state in Flink Runner

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 0.6.0
    • runner-flink
    • None

    Description

      By using the SPLIT_DISTRIBUTE OperatorState in flink to snapshot source checkpoints we make UnboundedSourceWrapper operators rescalable.

      Attachments

        Issue Links

          depends upon

          Improvement - An improvement or enhancement to an existing feature or task. BEAM-1393 Update Flink Runner to Flink 1.2.0

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Resolved
          links to

          Web Link GitHub Pull Request #2043

          Activity

            People

              lzljs3620320 Jingsong Lee
              lzljs3620320 Jingsong Lee
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: