Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
3.5.0
-
None
-
None
Description
ApplicationSubmissionContext#setApplicationTimeouts(Map<ApplicationTimeoutType, Long> applicationTimeouts)
This can be used to enforce application maximum lifetime. {}
{{}}
Javadoc at
https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html
It would be preferable to be able to set this to enforce timeout of an application.
{{}}
It is possible to set these cluster wide from yarn scheduler queues:
https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html
{{}}
{{}}
yarn.scheduler.capacity.<queue-path>.maximum-application-lifetime
yarn.scheduler.capacity.root.<queue-path>.default-application-lifetime
{{}}
however this is suboptimal in many cases as a submitted might have different requirements for application lifetime than the queue defaults.
{{}}