[HIVE-15240] Updating/Altering stats in metastore can be expensive in S3 - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Minor
Resolution: Fixed
Affects Version/s: 2.2.0
Fix Version/s: 2.3.0
Component/s: Metastore
Labels:
- 2.2.0

Description

https://github.com/apache/hive/blob/master/metastore/src/java/org/apache/hadoop/hive/metastore/HiveAlterHandler.java#L630

https://github.com/apache/hive/blob/master/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java#L367

If there are 100 partitions, it iterates every partition to determine its location taking up more than good amount of time.

Attachments

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HIVE-15240.1.patch
21/Nov/16 08:46
1 kB
Rajesh Balamohan
HIVE-15240.2.patch
22/Nov/16 03:29
4 kB
Rajesh Balamohan
HIVE-15240.3.patch
23/Nov/16 04:59
10 kB
Rajesh Balamohan
HIVE-15240.5.patch
25/Nov/16 06:09
9 kB
Rajesh Balamohan
HIVE-15240.6.patch
26/Nov/16 08:00
5 kB
Rajesh Balamohan

Issue Links

relates to

HIVE-15241 Update/Alter stats in metastore can be expensive in S3

Resolved

Activity

People

Assignee:: Rajesh Balamohan

Reporter:: Rajesh Balamohan

Votes:: 0 Vote for this issue

Watchers:: 5 Start watching this issue

Dates

Created:: 18/Nov/16 05:12

Updated:: 21/Jul/17 18:26

Resolved:: 30/Nov/16 06:03