Details
-
New Feature
-
Status: Resolved
-
Major
-
Resolution: Incomplete
-
2.4.5
-
None
Description
Currently there is no way to pass ownerReferences to the driver pod in cluster mode. This makes it difficult for the upstream process to clean up pods after they completed.
Something like this would be useful:
spark.kubernetes.driver.ownerReferences.[Name]