Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-5090

Use topological sort during ProcessBundle in Java SDKHarness

Details

    • Improvement
    • Status: Open
    • P3
    • Resolution: Unresolved
    • None
    • None
    • sdk-java-harness

    Description

      In reference to comment https://github.com/apache/beam/pull/6093#issuecomment-410831830

      • Use QueryablePipeline#getTopologicallyOrderedTransforms and execute processBundle requests.
      • Explore: is it worth caching the sorted structure when registerRequest is received.
      • Also, explore how we can handle cycles in the execution stage in process bundle request if any.

      Attachments

        Activity

          People

            Unassigned Unassigned
            angoenka Ankur Goenka
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: