Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-14058 FLIP-53 Fine-grained Operator Resource Management
  3. FLINK-14312

Support building logical pipelined regions from JobGraph

    XMLWordPrintableJSON

Details

    Description

      Logical pipelined region partitioning is needed by FLINK-14060 to determine JobVertex slot sharing group.
      We can leverage PipelinedRegionComputeUtil#computePipelinedRegions to do this by adapting JobGraph to a base Topology.

      With changes from FLINK-14453, we can build LogicalPipelinedRegions from JobGraph by:
      1. Introduce LogicalTopology which extends Topology
      2. Implement DefaultLogicalTopology as an adapter of JobGraph to LogicalTopology
      3. Add DefaultLogicalTopology#getLogicalPipelinedRegions to return the logical pipelined regions of a JobGraph

      Attachments

        Issue Links

          Activity

            People

              zhuzh Zhu Zhu
              zhuzh Zhu Zhu
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m