|
|
|
SPARK-42689
|
SPARK-25299
Allow ShuffleDriverComponent to declare if shuffle data is reliably stored
|
Mridul Muralidharan
|
Mridul Muralidharan
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-35188
|
SPARK-25299
Support json serde for the custom location
|
Unassigned
|
wuyi
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
SPARK-35186
|
SPARK-25299
Define local/hostlocal/remote fetch for custom storage
|
Unassigned
|
wuyi
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
SPARK-34942
|
SPARK-25299
Abstract Location in MapStatus to enable support for custom storage
|
Unassigned
|
wuyi
|
|
In Progress |
Unresolved
|
|
|
|
|
|
|
|
SPARK-32504
|
SPARK-25299
Shuffle Storage API: Dynamic updates of shuffle metadata
|
Unassigned
|
Matt Cheah
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
SPARK-31801
|
SPARK-25299
Register shuffle map output metadata with a shuffle output tracker
|
Unassigned
|
Matt Cheah
|
|
In Progress |
Unresolved
|
|
|
|
|
|
|
|
SPARK-31798
|
SPARK-25299
Return map output metadata from shuffle writers
|
Matt Cheah
|
Matt Cheah
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-30033
|
SPARK-25299
Use Spark plugin support to manage shuffle plugin lifecycle
|
Unassigned
|
Marcelo Masiero Vanzin
|
|
In Progress |
Unresolved
|
|
|
|
|
|
|
|
SPARK-28625
|
SPARK-25299
Shuffle Writer API: Indeterminate shuffle support in ShuffleMapOutputWriter
|
Unassigned
|
Yuanjian Li
|
|
Resolved |
Resolved
|
|
|
|
|
|
|
|
SPARK-28607
|
SPARK-25299
Don't hold a reference to two partitionLengths arrays
|
Matt Cheah
|
Matt Cheah
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-28592
|
SPARK-25299
Mark new Shuffle apis as @Experimental (instead of @Private)
|
Unassigned
|
Imran Rashid
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
SPARK-28571
|
SPARK-25299
Shuffle storage API: Use API in SortShuffleWriter
|
Matt Cheah
|
Matt Cheah
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-28570
|
SPARK-25299
Shuffle Storage API: Use writer API in UnsafeShuffleWriter
|
Matt Cheah
|
Matt Cheah
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-28568
|
SPARK-25299
Make Javadoc in org.apache.spark.shuffle.api visible
|
Hyukjin Kwon
|
Matt Cheah
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-28212
|
SPARK-25299
Shuffle Storage API: Shuffle Cleanup
|
Unassigned
|
Matt Cheah
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
SPARK-28211
|
SPARK-25299
Shuffle Storage API: Driver Lifecycle
|
Yifei Huang
|
Matt Cheah
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-28210
|
SPARK-25299
Shuffle Storage API: Reads
|
Unassigned
|
Matt Cheah
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
SPARK-28209
|
SPARK-25299
Shuffle Storage API: Writer API and usage in BypassMergeSortShuffleWriter
|
Matt Cheah
|
Matt Cheah
|
|
Resolved |
Fixed
|
|
|
|
|