Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-11093

Fine grained table refreshing doesn't refresh table file metadata

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Impala 4.1.0
    • Impala 4.1.0
    • Catalog
    • None

    Description

      If we insert data into an acid partitioned table from Hive, the generated events will be like open_txn -> alter_partition -> commit_txn.

      In alter_partition event, we will refresh the partition (without refreshing file metadata) because the write id with the partition object in the event > write id of the cached partition. Then, in commit_txn event, we still do the same write id check. However, the write id is still the same, so we end up don't fresh file metadata. 

      Attachments

        Issue Links

          Activity

            People

              hsnusonic Yu-Wen Lai
              hsnusonic Yu-Wen Lai
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: