Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
3.0.0
-
None
Description
Some of following memory and storage related configs are still hardcoded, We try to use ConfigEntry and put them in the config package :
spark.storage.cleanupFilesAfterExecutorExit
spark.diskStore.subDirectories
spark.block.failures.beforeLocationRefresh
spark.storage.unrollMemoryThreshold
spark.storage.memoryMapThreshold
spark.memory.storageFraction
spark.memory.offHeap.enabled
spark.memory.offHeap.size
Attachments
Issue Links
- links to