Details
-
Bug
-
Status: Open
-
P3
-
Resolution: Unresolved
-
None
-
None
-
None
Description
Over at BEAM-8539 we're trying to iron out the definitions of the job state enums. One thing that is clear is that STOPPED is not supposed to be a terminal state, though since it was poorly documented it slipped in a few places.
There are two places in the SparkPipelineResult where STOPPED seems to be used as a terminal event. These should either be DONE, FAILED, or CANCELLED.
Here's one example: