Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
Description
When generating plan for incremental materialized view rebuild a filter operator is inserted on top of each source table scans. The predicates contain a filter for writeId since we want to get all the rows inserted/deleted from the source tables since the last rebuild only.
WriteId is part of the ROW_ID virtual column and only available for fully-ACID ORC tables.
The goal of this jira is to populate a writeId when fetching from insert-only transactional tables.
create table t1(a int, b int) clustered by (a) into 2 buckets stored as orc TBLPROPERTIES ('transactional'='true', 'transactional_properties'='insert_only'); ... SELECT t1.ROW__ID.writeId, a, b FROM t1;
Attachments
Issue Links
- is related to
-
HIVE-25546 Enable incremental rebuild of Materialized views with insert only source tables
- Resolved
- links to