Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-12835

Transactional tables are unsynced when hms_event_incremental_refresh_transactional_table is disabled

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • Impala 4.4.0
    • Catalog
    • None

    Description

      There are some test failures when hms_event_incremental_refresh_transactional_table is disabled:

      • tests/metadata/test_event_processing.py::TestEventProcessing::test_transactional_insert_events
      • tests/metadata/test_event_processing.py::TestEventProcessing::test_event_based_replication

      I can reproduce the issue locally:

      $ bin/start-impala-cluster.py --catalogd_args=--hms_event_incremental_refresh_transactional_table=false
impala-shell> create table txn_tbl (id int, val int) stored as parquet tblproperties ('transactional'='true','transactional_properties'='insert_only');
impala-shell> describe txn_tbl;  -- make the table loaded in Impala

hive> insert into txn_tbl values(101, 200);

impala-shell> select * from txn_tbl;

      Impala shows no results until a REFRESH runs on this table.

      Attachments

        Issue Links

          is caused by

          Improvement - An improvement or enhancement to an existing feature or task. IMPALA-11534 Skip reloading file metadata for some ALTER_TABLE events

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-12895 REFRESH doesn't detect changes in partition locations in ACID tables

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-12902 Event replication can be broken if hms_event_incremental_refresh_transactional_table=false

          • Major - Major loss of function.
          • Open
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. IMPALA-10923 Fine grained table refreshing at partition level events for transactional tables

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              csringhofer Csaba Ringhofer
              stigahuang Quanlong Huang
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: