Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-3698

Support SDF over Fn API

    XMLWordPrintableJSON

Details

    Description

      SDF is the only API for emitting unbounded data in Fn API. This issue is about supporting SDF in an SDK harness, with its checkpointing controlled by the runner harness.

      ++Umbrella issue: includes design and implementation in various SDK languages.

      First practically useful goal in sight: Kafka source implemented in the Python SDK, running over Fn API using the Dataflow runner.

      Attachments

        Issue Links

          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. BEAM-2939 Fn API SDF support

          • P3 - Non-urgent bugs, features, and improvements
          • Resolved

          Activity

            People

              jkff Eugene Kirpichov
              jkff Eugene Kirpichov
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: