[SPARK-27360] Standalone cluster mode support for GPU-aware scheduling - ASF JIRA

XML

Word

Printable

JSON

Design and implement standalone manager support for GPU-aware scheduling:

1. static conf to describe resources
2. spark-submit to request resources
2. auto discovery of GPUs
3. executor process isolation

is blocked by

SPARK-27024 Executor interface for cluster managers to support GPU resources

1.	Design: Standalone supports GPU scheduling	Resolved	Xiangrui Meng
2.	Standalone worker can load resource conf and discover resources	Resolved	wuyi
3.	Standalone master receives resource info from worker and allocate driver/executor properly	Resolved	wuyi
4.	Standalone worker/master UI updates for Resource scheduling	Resolved	wuyi
5.	Remove resource coordination support from Standalone	Resolved	wuyi