Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-3972

Flink runner translates batch pipelines directly by proto

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • Not applicable
    • runner-flink
    • None

    Description

      The non-portable runner uses reydrated pipelines which lack necessary information. The portable Flink runner needs to translate pipelines directly by proto in order to wire components into individual executable stages correctly.

      Attachments

        Issue Links

          depends upon

          New Feature - A new feature of the product, which has yet to be developed. BEAM-4056 Identify Side Inputs by PTransform ID and local name

          • P3 - Non-urgent bugs, features, and improvements
          • Resolved
          is depended upon by

          Sub-task - The sub-task of the issue BEAM-2898 Flink supports chaining/fusion of single-SDK stages

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. BEAM-2889 Flink runs portable pipelines

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. BEAM-3971 Pipeline translation utilities should not use SDK construction classes

          • P3 - Non-urgent bugs, features, and improvements
          • Resolved
          relates to

          New Feature - A new feature of the product, which has yet to be developed. BEAM-4127 Flink portable runner translates streaming pipelines by proto

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Resolved
          links to

          Web Link GitHub Pull Request #5226

          Activity

            People

              bsidhom Ben Sidhom
              bsidhom Ben Sidhom
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 8h 40m
                  8h 40m