Details
-
Improvement
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
2.4.3
-
None
Description
spark.memory.offHeap.size accept 1G or 1KB also. So User is able to give suffix also but description say only 'absolute amount of memory in bytes'.
This require to update like spark.driver.memory where it is mentioned is accepts a size unit suffix ("k", "m", "g" or "t") (e.g. 512m, 2g).
| spark.memory.offHeap.size | 0 | The absolute amount of memory in bytes which can be used for off-heap allocation. This setting has no impact on heap memory usage, so if your executors' total memory consumption must fit within some hard limit then be sure to shrink your JVM heap size accordingly. This must be set to a positive value when spark.memory.offHeap.enabled=true. |
Attachments
Issue Links
- links to