Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
2.0.0
-
None
Description
When merging spill files using Java file streams, UnsafeShuffleWriter opens a decompression stream for each shuffle part and never closes them. When the compression codec holds off-heap resources, these aren't cleaned up until the finalizer is called.