[SPARK-31207] Ensure the total number of blocks to fetch equals to the sum of local/hostLocal/remote blocks - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: 3.1.0
Fix Version/s: 3.0.0
Component/s: Spark Core
Labels:
None

Description

Assert the number of blocks to fetch equals the number of local blocks + the number of hostLocal blocks + the number of remote blocks in ShuffleBlockFetcherIterator.

Attachments

Issue Links

links to

GitHub Pull Request #27972

Activity

People

Assignee:: Xingbo Jiang

Reporter:: Xingbo Jiang

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 20/Mar/20 18:46

Updated:: 25/Mar/20 05:52

Resolved:: 25/Mar/20 05:52