Bulk Operation

SPARK-45869 Ensure trailing slashes in `HistoryServer` URL redirections

SPARK-45869 Add `Environment` page to Master UI

SPARK-45869 Make `BlockManager` warn before `removeBlockInternal`

SPARK-45869 Make `PluginEndpoint` warn when plugins reply for one-way message

SPARK-45869 Reduce the number of required threads in MasterSuite

SPARK-45869 Support `spark.driver.timeout` and `DriverTimeoutPlugin`

SPARK-45869 Fix `MasterSuite` to validate the number of registered workers

SPARK-45869 Exclude `CodeHaus Jackson` dependencies from Master/Worker/HistoryServer classpaths

SPARK-45869 Add `WebBrowserTest`

SPARK-45869 Fix `RealBrowserUISeleniumSuite`

SPARK-45869 Use `getTotalMemorySize` in `WorkerArguments`

SPARK-45869 Enable `spark.worker.cleanup.enabled` by default

SPARK-45869 Hide `Thread Dump` and `Heap Histogram` of `Dead` executors in `Executors` UI

SPARK-45869 Check logType in Utils.getLog

SPARK-45869 Fix `Load New` button in `Master/HistoryServer` Log UI

SPARK-45869 Show driver log location in Spark History Server

SPARK-45869 Support Spark History Server Log UI

SPARK-45869 Remove POST APIs from `MasterWebUI` when spark.ui.killEnabled is false

SPARK-45869 Validate `spark.master.ui.decommission.allow.mode` setting

SPARK-45869 Fix `Master` to reject worker kill request if decommission is disabled

SPARK-45869 Support `/json/clusterutilization` API

SPARK-45869 Support `spark.deploy.workerSelectionPolicy`

SPARK-45869 Recover `log-view.js` to be non-module

SPARK-45869 Support Spark Master Log UI

SPARK-45869 Add `logrotate` to Spark docker files

SPARK-45869 Support Spark Worker Log UI

SPARK-45869 Make `WorkerResourceInfo` extend `Serializable` explicitly

SPARK-45869 Make RocksDBPersistenceEngine to support a symbolic link

SPARK-45869 Fix `spark-daemon.sh` usage by adding `decommission` command

SPARK-45869 Support `spark.deploy.spreadOutDrivers`

SPARK-45869 Improve `MasterSuite` to use nanoTime-based appIDs and workerIDs

SPARK-45869 Rename spark.deploy.spreadOut to spark.deploy.spreadOutApps

SPARK-45869 Document `SPARK_LOG_*` and `SPARK_PID_DIR`

SPARK-45869 Remove `*slave*.sh` scripts

SPARK-45869 Fix `MasterPage` to sort `Running Drivers` table by `Duration` column correctly

SPARK-45869 Improve `Master` to recover quickly in case of zero workers and apps

SPARK-45869 Remove `kill` link from RELAUNCHING drivers in MasterPage

SPARK-45869 Support `readyz` in REST Submission API

SPARK-45869 Refactor to improve `RegisterWorker` unit test

SPARK-45869 Support `spark.deploy.recoveryTimeout`

SPARK-45869 Fix Master to update worker from UNKNOWN to ALIVE on RegisterWorker message

SPARK-45869 Warn properly when a driver exists successfully but master is disconnected

SPARK-45869 Support `spark.master.rest.host`

SPARK-45869 Log Spark HA recovery duration

SPARK-45869 Log the final state of drivers during `Master.removeDriver`

SPARK-45869 Support `spark.worker.(initial|max)RegistrationRetries`

SPARK-45869 Make `spark.deploy.recovery*` documentation up-to-date

SPARK-45869 Show a summary of workers in MasterPage

SPARK-45869 Add RocksDBPersistenceEngine

SPARK-45869 Include `Driver/App` data in `PersistenceEngineBenchmark`

SPARK-45869 Improve `FileSystemPersistenceEngine` to support compressions

SPARK-45869 Improve `FileSystemPersistenceEngine` to allow non-exist parents

SPARK-45869 Improve `PersistenceEngine` performance with `KryoSerializer`

SPARK-45869 Add PersistenceEngineBenchmark

SPARK-45869 Improve `FileSystemPersistenceEngine.persist` error message in case of the existing file

SPARK-45869 Document REST API for Spark Standalone Cluster

SPARK-45869 EventLogFileReader should not read rolling logs if appStatus is missing

SPARK-45869 Document `spark.master.*` configurations

SPARK-45869 Make single-pod spark jobs respect spark.app.id

SPARK-45869 Fix `Spark Standalone` documentation table layout

SPARK-45869 Collect and update `spark-standalone.md` with new confs

SPARK-45869 Support `spark.worker.idPattern`

SPARK-45869 Support `killall` in REST Submission API

SPARK-45869 Support `clear` in REST Submission API

SPARK-45869 Support `spark.deploy.appNumberModulo` to rotate app number

SPARK-45869 Support `spark.test.appId` in `LocalSchedulerBackend`

SPARK-45869 Support `spark.master.ui.historyServerUrl` in `ApplicationPage`

SPARK-45869 Improve `MasterPage` to show `Resource` column only when it exists

SPARK-45869 Support `spark.master.useAppNameAsAppId.enabled`

SPARK-45869 Support `spark.deploy.appIdPattern`

SPARK-45869 Support `spark.deploy.driverIdPattern`

SPARK-45869 Fix Spark History Server to sort `Duration` column properly

SPARK-45869 Show the number of abnormally completed drivers in MasterPage

SPARK-45869 Support top-level filtering in MasterPage JSON API

SPARK-45869 Show the number of drivers waiting in SUBMITTED status

SPARK-45869 Make StandaloneRestServer add JavaModuleOptions to drivers

SPARK-45869 Fix WorkerPage to use the same pattern for `logPage` urls

SPARK-45869 Support `spark.deploy.maxDrivers`

SPARK-45869 Fix getBaseURI error in Spark Worker LogPage UI buttons

SPARK-45869 Support Spark Driver Live Log UI