Details
-
Improvement
-
Status: Open
-
P3
-
Resolution: Unresolved
-
None
-
None
-
None
Description
Native engine metrics are updated on finishBundle by DoFnRunners. Spark uses SimpleDoFnRunner that is in runner-core and thus contains nothing spark native. It might be good to extend SimpleDoFnRunner to add native metrics support just like it was done in Flink with DoFnRunnerWithMetrics class.
Attachments
Issue Links
- relates to
-
BEAM-7219 Spark portable runner: support Spark metrics
- Open