Details
-
Bug
-
Status: Resolved
-
P2
-
Resolution: Fixed
-
None
-
None
Description
Both the flink and the spark runners attempt to override the Reshuffle transform via the urn - e.g. https://github.com/apache/beam/blob/master/runners/flink/src/main/java/org/apache/beam/runners/flink/FlinkBatchTransformTranslators.java#L114 .
Unfortunately there's no TransformPayloadTranslatorRegistrar for Reshuffle. This means the call to urnForTransformOrNull will always return null for a Reshuffle so they are never translated.
Attachments
Issue Links
- links to