Bulk Operation

SPARK-33005 K8s integration test should use the runtime Hadoop Version

SPARK-33005 Ignore RegisterExecutor when SparkContext is stopped

SPARK-33005 KubernetesClusterSchedulerBackend.stop should clean up K8s resources

SPARK-33005 ExecutorPodsAllocator fails to identify some excess requests during downscaling

SPARK-33005 Promote spark.kubernetes.executor.podNamePrefix to the public conf

SPARK-33005 Fix flaky test in DecommissionWorkerSuite

SPARK-33005 Long runtime on many environment variables

SPARK-33005 NPE in ExecutorPodsSnapshot

SPARK-33005 Fix fallback storage offset and improve compression codec test coverage

SPARK-33005 Exclude fallback block manager from executorList

SPARK-33005 Update dynamic allocation related documents

SPARK-33005 Spark may report PodRunning if there is a sidecar that has not exited

SPARK-33005 Update kubernetes/integration-tests/README.md to follow the default Hadoop profile updated

SPARK-33005 Support PYSPARK_PYTHON and PYSPARK_DRIVER_PYTHON environment variables

SPARK-33005 Kubernetes integration tests doesn't work with Minikube 1.9+

SPARK-33005 `gpg: keyserver receive failed: No name` during K8s IT

SPARK-33005 Decommissioning Race Condition during Pod Snapshot

SPARK-33005 Race condition in Spark k8s Pod lifecycle manager that leads to shutdowns

SPARK-33005 Fix flaky test "Verify logging configuration is picked from the provided SPARK_CONF_DIR/log4j.properties."

SPARK-33005 Allow k8s integration tests to assert both driver and executor logs for expected log(s)

SPARK-33005 Make spark.archives working in Kubernates

SPARK-33005 Support Fallback Storage during Worker decommission

SPARK-33005 Upgrade kubernetes-client to 4.12.0

SPARK-33005 Use R 3.6.3 in K8s R image

SPARK-33005 Support ordered shuffle block migration

SPARK-33005 Upgrade kubernetes-client to 4.11.1

SPARK-33005 Support k8s cluster manager with stage level scheduling

SPARK-33005 Keep pending pods in account while scheduling new pods

SPARK-33005 Use default Hadoop profile by removing explicit `-Phadoop-2.7` from K8s IT Jenkins job

SPARK-33005 Update misleading log messages for removed shuffle blocks

SPARK-33005 Fix BlockManagerDecommissioner to return the correct migration status

SPARK-33005 getMigrationBlocks should not fail at missing files

SPARK-33005 Use 11-jre-slim as default in K8s Dockerfile

SPARK-33005 Detect duplicated mountPath and fail at Spark side

SPARK-33005 Make spark.kubernetes.pyspark.pythonVersion allow `Python 3` only

SPARK-33005 Handle shuffle blocks being removed during decommissioning

SPARK-33005 Respect executor idle timeout conf in ExecutorPodsAllocator

SPARK-33005 Use LinkedHashMap instead of Map for newlyCreatedExecutors

SPARK-33005 Improve error message for insufficient K8s volume confs

SPARK-33005 Upgrade fabric8 to 4.10.3

SPARK-33005 Add dynamic PVC usage example into K8s doc

SPARK-33005 Support dynamic PVC creation/deletion for K8s driver

SPARK-33005 Support dynamic PVC creation/deletion for K8s executors

SPARK-33005 Remove python2 installation in K8s python image

SPARK-33005 Support execId placeholder in executor PVC conf

SPARK-33005 Spark executors on K8S do not request extra memory for off-heap allocations

SPARK-33005 Decommissioning Integration Test checks for old string

SPARK-33005 Support appId/execId placeholder in K8s SPARK_EXECUTOR_DIRS

SPARK-33005 Remove the words "experimental" in the k8s document

SPARK-33005 Add StorageLevel.DISK_ONLY_3

SPARK-33005 Fix mismatched versions in test artifacts

SPARK-33005 Fix typo of parameter in KubernetesTestComponents

SPARK-33005 Fix & re-enable failing R K8s tests

SPARK-33005 Remove Python2 test from K8s IT

SPARK-33005 Kubernetes Configuration to set Service Account to Executors

SPARK-33005 ExecutorPlugin doesn't work with Standalone Cluster and Kubernetes with --jars

SPARK-33005 Use unique ConfigMap name for executor pod template

SPARK-33005 Support for Kubernetes NFS volume mounts

SPARK-33005 Expose the ability for user to cleanup shuffle files

SPARK-33005 When processing new K8s state snapshots Spark treats Terminating nodes as terminated.

SPARK-33005 Improve Spark Decommissioning K8s test relability

SPARK-33005 Fix flaky "Test basic decommissioning" test

SPARK-33005 Driver cores in kubernetes are coupled with container resources, not spark.driver.cores

SPARK-33005 Allow setting serviceAccountName for executor pods

SPARK-33005 ExecutorPodsLifecycleManager has sub-optimal behavior with dynamic allocation

SPARK-33005 Support local dependency uploading from --py-files

SPARK-33005 Allow using some alternatives for service accounts

SPARK-33005 Support --proxy-user for Spark on K8s

SPARK-33005 Spark client terminates while driver is still running