Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-5212

Update native spark metrics

Details

    • Improvement
    • Status: Open
    • P3
    • Resolution: Unresolved
    • None
    • None
    • runner-spark
    • None

    Description

      Native engine metrics are updated on finishBundle by DoFnRunners. Spark uses SimpleDoFnRunner that is in runner-core and thus contains nothing spark native. It might be good to extend SimpleDoFnRunner to add native metrics support just like it was done in Flink with DoFnRunnerWithMetrics class.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              echauchot Etienne Chauchot
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: