Details
-
Sub-task
-
Status: Closed
-
Major
-
Resolution: Fixed
-
1.11.0
Description
With FLINK-14106, memory of a TaskExecutor is decided in two steps on active resource managers.
- SlotManager decides WorkerResourceSpec, including memory used by Flink tasks: task heap, task off-heap, network and managed memory.
- ResourceManager derives TaskExecutorProcessSpec from WorkerResourceSpec and the configuration, deciding sizes of memory used by Flink framework and JVM: framework heap, framework off-heap, jvm metaspace and jvm overhead.
This works fine for now, because both WorkerResourceSpec and TaskExecutorProcessSpec are derived from the same configurations. However, it might cause problem if later we have new SlotManager implementations that decides WorkerResourceSpec dynamically. In such cases, the process/flink sizes in configuration should be ignored, or it may easily lead to configuration conflicts.
Attachments
Issue Links
- is related to
-
FLINK-14106 Make SlotManager pluggable
- Closed
- links to