Details
-
Improvement
-
Status: Open
-
P3
-
Resolution: Unresolved
-
None
-
None
Description
Currently each PCollectionView is "created" by a primitive CreatePCollectionView primitive in the Java SDK. This is an artifact of how runners translated the View transforms.
But in portability (and actually before that) PCollectionView is just a POJO of metadata for how to read a PCollection as a side input. It is PValue to the Java SDK but in portability there is only one kind of value: PCollection.
Runners should not depend on the exact expansion of the View transforms.
Until they are all migrated off of it, the transform must be left in the expanion, so runners who are migrated off of it will need to remove it from their translation or insert a noop.
Attachments
Issue Links
- is cloned by
-
BEAM-11392 Resolve beam_fn_api flag that changes how side inputs are represented in Beam
- Open