Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-2862 Add support for User State over the Fn API
  3. BEAM-2902

Add user state support for ParDo.Multi for the Dataflow runner

Details

    Description

      Add support for user state in a ParDo.Multi by:

      • adding expansion/conversion logic within Dataflow service to add any needed GBKs to allow expansion.

      OR

      • Add support for expansion inside the Beam SDK once the PTransformMatcher exposes a way to know when the replacement is not required by checking that the preceding ParDos to a GBK are key preserving.

      Attachments

        Activity

          People

            lcwik Luke Cwik
            lcwik Luke Cwik
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: