[TEZ-4199] MergeManager::finalMerge should make use of compression - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.10.0, 0.9.3
Component/s: None
Labels:
None

Description

https://github.com/apache/tez/blob/master/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/orderedgrouped/MergeManager.java#L1304

Passed on codec is not used in TezMerger.

Attachments

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

Screenshot 2020-07-13 at 2.25.11 PM.png
13/Jul/20 08:58
253 kB
Rajesh Balamohan
TEZ-4199.1.patch
14/Jul/20 16:48
5 kB
Mustafa İman
TEZ-4199.2.patch
14/Jul/20 23:14
5 kB
Mustafa İman
TEZ-4199.2.patch
16/Jul/20 15:50
5 kB
Mustafa İman
TEZ-4199.3.patch
17/Jul/20 01:23
10 kB
Mustafa İman
TEZ-4199.3.patch
17/Jul/20 05:06
11 kB
Mustafa İman

Issue Links

is related to

TEZ-4295 Could not decompress data. Buffer length is too small.

Resolved

relates to

TEZ-4234 Compressor can cause IllegalArgumentException in Buffer.limit where limit exceeds capacity

Resolved

Activity

People

Assignee:: Mustafa İman

Reporter:: Rajesh Balamohan

Votes:: 0 Vote for this issue

Watchers:: 4 Start watching this issue

Dates

Created:: 13/Jul/20 08:58

Updated:: 28/Apr/21 07:12

Resolved:: 17/Jul/20 16:55

Time Tracking

Estimated:

Not Specified

Remaining:

0h

Logged:

20m