Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-10947 SQL support for querying Iceberg metadata
  3. IMPALA-12527

test_metadata_tables could occasionally fail in the s3 build

    XMLWordPrintableJSON

Details

    • ghx-label-11

    Description

      We found that test_metadata_tables() that runs iceberg-metadata-tables.test could occasionally fail with the following error message.

      It looks like the actual result does not match the expected result for some columns.

      Stacktrace

      query_test/test_iceberg.py:1226: in test_metadata_tables
          '$OVERWRITE_SNAPSHOT_TS': str(overwrite_snapshot_ts.data[0])})
      common/impala_test_suite.py:751: in run_test_case
          self.__verify_results_and_errors(vector, test_section, result, use_db)
      common/impala_test_suite.py:587: in __verify_results_and_errors
          replace_filenames_with_placeholder)
      common/test_result_verifier.py:487: in verify_raw_results
          VERIFIER_MAP[verifier](expected, actual)
      common/test_result_verifier.py:296: in verify_query_result_is_equal
          assert expected_results == actual_results
      E   assert Comparing QueryTestResults (expected vs actual):
      E     row_regex:0,'s3a://impala-test-uswest2-2/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/.*.parq','PARQUET',0,1,[1-9]\d*|0,'',0 != 0,'/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/7d479ffb82bfffd3-7ce667e500000000_544607964_data.0.parq','PARQUET',0,1,351,'NULL',0
      E     row_regex:0,'s3a://impala-test-uswest2-2/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/.*.parq','PARQUET',0,1,[1-9]\d*|0,'',0 != 0,'/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/ab4ffd0d75a5a68d-13da083100000000_1541521750_data.0.parq','PARQUET',0,1,351,'NULL',0
      E     row_regex:0,'s3a://impala-test-uswest2-2/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/.*.parq','PARQUET',0,1,[1-9]\d*|0,'',0 != 0,'/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/b04d1095845359f5-f0799bd000000000_1209897284_data.0.parq','PARQUET',0,1,351,'NULL',0
      E     row_regex:1,'s3a://impala-test-uswest2-2/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/.*.parq','PARQUET',0,1,[1-9]\d*|0,'NULL',NULL != 1,'/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/delete-1b45db885b2bdd56-4023218d00000002_1697110314_data.0.parq','PARQUET',0,1,1531,'NULL',NULL
      

      Specifically, it seems the value of the second last column are different from the expected value in some rows.

      Attachments

        Activity

          People

            tmate Tamas Mate
            fangyurao Fang-Yu Rao
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: