Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-36057 SPIP: Support Customized Kubernetes Schedulers
  3. SPARK-38135

Introduce `spark.kubernetes.job` sheduling related configurations

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Invalid
    • 3.3.0
    • None
    • Kubernetes
    • None

    Description

      spark.kubernetes.job.minCPU:  the minimum cpu resources for running job
      spark.kubernetes.job.minMemory:  the minimum memory resources for running job
      spark.kubernetes.job.minMember: the minimum number of pods for running job
      spark.kubernetes.job.priorityClassName: the priority of the running job
      spark.kubernetes.job.queue: the queue to which the running job belongs

      Attachments

        Activity

          People

            Unassigned Unassigned
            yikunkero Yikun Jiang
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: