[HIVE-25947] Compactor job queue cannot be set per table via compactor.mapred.job.queue.name - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 4.0.0-alpha-1
Component/s: HiveServer2
Labels:
- pull-request-available

Target Version/s:

4.0.0

Description

Before ~~HIVE-20723~~ it was possible to schedule the compaction for each table on specific job queues by putting compactor.mapred.job.queue.name in the table properties.

CREATE TABLE person (name STRING, age INT) STORED AS ORC TBLPROPERTIES(
'transactional'='true',
'compactor.mapred.job.queue.name'='root.user2);

ALTER TABLE person COMPACT 'major' WITH OVERWRITE TBLPROPERTIES('compactor.mapred.job.queue.name'='root.user2')

This is no longer possible (after ~~HIVE-20723~~) and in order to achieve the same effect someone needs to use the compactor.hive.compactor.job.queue.

CREATE TABLE person (name STRING, age INT) STORED AS ORC TBLPROPERTIES(
'transactional'='true',
'compactor.hive.compactor.job.queue'='root.user2);

ALTER TABLE person COMPACT 'major' WITH OVERWRITE TBLPROPERTIES('compactor.hive.compactor.job.queue'='root.user2')

Attachments

Issue Links

is caused by

HIVE-20723 Allow per table specification of compaction yarn queue

Closed

links to

GitHub Pull Request #3027

Activity

People

Assignee:: Stamatis Zampetakis

Reporter:: Stamatis Zampetakis

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 10/Feb/22 10:10

Updated:: 17/Nov/22 08:48

Resolved:: 18/Feb/22 10:42

Time Tracking

Estimated:

Not Specified

Remaining:

Logged:

2.5h