[HIVE-22290] ObjectStore.cleanWriteNotificationEvents and ObjectStore.cleanupEvents OutOfMemory on large number of pending events - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: 4.0.0
Fix Version/s: None
Component/s: HCatalog, repl
Labels:
- pull-request-available

Description

As in https://jira.apache.org/jira/browse/HIVE-19430 if there are large number of events that haven't been cleaned up for some reason, then ObjectStore.cleanWriteNotificationEvents() and ObjectStore.cleanupEvents can run out of memory while it loads all the events to be deleted.
It should fetch events in batches.

Attachments

Issue Links

links to

GitHub Pull Request #1484

Activity

People

Assignee:: Naresh P R

Reporter:: Thomas Prelle

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 03/Oct/19 13:43

Updated:: 16/Sep/20 03:07

Resolved:: 16/Sep/20 03:07

Time Tracking

Estimated:

Not Specified

Remaining:

Logged:

40m