[HIVE-13934] Configure Tez to make nocondiional task size memory available for the Processor - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: 2.1.0
Fix Version/s: 2.1.1, 2.2.0
Component/s: Hive
Labels:
- TODOC2.1.1

Target Version/s:

2.1.1, 2.2.0

Description

Currently, noconditionaltasksize is not validated against the container size, the reservations made in the container by Tez for Inputs / Outputs etc.

Check this at compile time to see if enough memory is available, or set up the vertex to reserve additional memory for the Processor.

Attachments

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HIVE-13934.11.patch
20/Jul/16 05:32
12 kB
Wei Zheng
HIVE-13934.10.patch
20/Jul/16 00:22
12 kB
Wei Zheng
HIVE-13934.9.patch
15/Jul/16 22:20
15 kB
Wei Zheng
HIVE-13934.8.patch
12/Jul/16 22:53
14 kB
Wei Zheng
HIVE-13934.7.patch
08/Jul/16 22:33
14 kB
Wei Zheng
HIVE-13934.6.patch
08/Jul/16 17:53
14 kB
Wei Zheng
HIVE-13934.4.patch
06/Jul/16 19:56
4 kB
Wei Zheng
HIVE-13934.3.patch
05/Jul/16 23:45
4 kB
Wei Zheng
HIVE-13934.2.patch
17/Jun/16 21:34
8 kB
Wei Zheng
HIVE-13934.1.patch
16/Jun/16 17:03
8 kB
Wei Zheng

Issue Links

blocks

HIVE-13809 Hybrid Grace Hash Join memory usage estimation didn't take into account the bloom filter size

Closed

is blocked by

TEZ-3286 Allow clients to set processor reserved memory per vertex (instead of per container)

Closed

relates to

TEZ-3353 Tez should adjust processor memory on demand

Open

Activity

People

Assignee:: Wei Zheng

Reporter:: Wei Zheng

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 02/Jun/16 23:45

Updated:: 08/Dec/16 14:38

Resolved:: 22/Jul/16 20:33