Details
-
Sub-task
-
Status: Closed
-
Major
-
Resolution: Fixed
-
1.10.0
Description
With FLINK-14058, it is assumed that a shared slot should be large enough to be used by one instance of each JobVertex in the group simultaneously.
To support it, a shared slot resources should be the sum of all JobVertex resources in the group.
Here's the concrete proposal:
1. Add a physicalSlotResourceProfile in SlotProfile. If the task is not in a shared slot, it is the task resource profile. Otherwise it is the slot sharing group resource profile. It should be used for physical slot allocation. Rename previous ResourceProfile to be taskResourceProfile for logical slot allocation.
2. SharedSlotOversubscribedException and its handling can be removed, including part of the children slots releasing and re-allocating. This is because partial fulfillment should not happen anymore with #1. A simple sanity check can be kept for oversubscribing.
Attachments
Issue Links
- is blocked by
-
FLINK-14060 Set slot sharing groups according to pipelined regions
- Resolved
-
FLINK-14594 Fix matching logics of ResourceSpec/ResourceProfile/Resource considering double values
- Closed
-
FLINK-14734 Add a ResourceSpec in SlotSharingGroup to describe its overall resources
- Closed
- links to