XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.3.0
    • 3.3.0
    • Kubernetes
    • None

    Description

      Currently executor rolling will always kill one executor every spark.kubernetes.executor.rollInterval. This may not be optimal in cases where the executor metric isn't an outlier compared to other executors. There is a cost associated with killing executors (ramp-up time for new executors for example) which applications may not want to incur for non-outlier executors.

       

      This ticket would add the ability to only kill executors if they are outliners via the introduction of a new roll policy.

      Attachments

        Activity

          People

            alex.holmes Alex Holmes
            grep.alex Alex Holmes
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: