Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-12967

Testcase fails at test_migrated_table_field_id_resolution due to "Table does not exist"

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Backend
    • ghx-label-9

    Description

      Testcase test_migrated_table_field_id_resolution fails at exhaustive release build with following messages:
      Regression

      query_test.test_iceberg.TestIcebergTable.test_migrated_table_field_id_resolution[protocol: beeswax | exec_option: {'test_replan': 1, 'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': True, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: parquet/none] (from pytest)
      

      Error Message

      query_test/test_iceberg.py:266: in test_migrated_table_field_id_resolution     "iceberg_migrated_alter_test_orc", "orc") common/file_utils.py:68: in create_iceberg_table_from_directory     file_format)) common/impala_connection.py:215: in execute     fetch_profile_after_close=fetch_profile_after_close) beeswax/impala_beeswax.py:191: in execute     handle = self.__execute_query(query_string.strip(), user=user) beeswax/impala_beeswax.py:384: in __execute_query     self.wait_for_finished(handle) beeswax/impala_beeswax.py:405: in wait_for_finished     raise ImpalaBeeswaxException("Query aborted:" + error_log, None) E   ImpalaBeeswaxException: ImpalaBeeswaxException: E    Query aborted:ImpalaRuntimeException: Error making 'createTable' RPC to Hive Metastore:  E   CAUSED BY: IcebergTableLoadingException: Table does not exist at location: hdfs://localhost:20500/test-warehouse/iceberg_migrated_alter_test_orc
      Stacktrace
      query_test/test_iceberg.py:266: in test_migrated_table_field_id_resolution
          "iceberg_migrated_alter_test_orc", "orc")
      common/file_utils.py:68: in create_iceberg_table_from_directory
          file_format))
      common/impala_connection.py:215: in execute
          fetch_profile_after_close=fetch_profile_after_close)
      beeswax/impala_beeswax.py:191: in execute
          handle = self.__execute_query(query_string.strip(), user=user)
      beeswax/impala_beeswax.py:384: in __execute_query
          self.wait_for_finished(handle)
      beeswax/impala_beeswax.py:405: in wait_for_finished
          raise ImpalaBeeswaxException("Query aborted:" + error_log, None)
      E   ImpalaBeeswaxException: ImpalaBeeswaxException:
      E    Query aborted:ImpalaRuntimeException: Error making 'createTable' RPC to Hive Metastore: 
      E   CAUSED BY: IcebergTableLoadingException: Table does not exist at location: hdfs://localhost:20500/test-warehouse/iceberg_migrated_alter_test_orc
      

      Standard Error

      SET client_identifier=query_test/test_iceberg.py::TestIcebergTable::()::test_migrated_table_field_id_resolution[protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':True;'abort_on_error':1;'exec_single_;
      SET sync_ddl=False;
      -- executing against localhost:21000
      
      DROP DATABASE IF EXISTS `test_migrated_table_field_id_resolution_b59d79db` CASCADE;
      
      -- 2024-04-02 00:56:55,137 INFO     MainThread: Started query f34399a8b7cddd67:031a3b9600000000
      SET client_identifier=query_test/test_iceberg.py::TestIcebergTable::()::test_migrated_table_field_id_resolution[protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':True;'abort_on_error':1;'exec_single_;
      SET sync_ddl=False;
      -- executing against localhost:21000
      
      CREATE DATABASE `test_migrated_table_field_id_resolution_b59d79db`;
      
      -- 2024-04-02 00:56:57,302 INFO     MainThread: Started query 94465af69907eac5:e33f17e000000000
      -- 2024-04-02 00:56:57,353 INFO     MainThread: Created database "test_migrated_table_field_id_resolution_b59d79db" for test ID "query_test/test_iceberg.py::TestIcebergTable::()::test_migrated_table_field_id_resolution[protocol: beeswax | exec_option: {'test_replan': 1, 'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': True, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: parquet/none]"
      Picked up JAVA_TOOL_OPTIONS:  -javaagent:/data/jenkins/workspace/impala-asf-master-exhaustive-release/repos/Impala/fe/target/dependency/jamm-0.4.0.jar
      Picked up JAVA_TOOL_OPTIONS:  -javaagent:/data/jenkins/workspace/impala-asf-master-exhaustive-release/repos/Impala/fe/target/dependency/jamm-0.4.0.jar
      -- executing against localhost:21000
      
      create external table test_migrated_table_field_id_resolution_b59d79db.iceberg_migrated_alter_test stored as iceberg location '/test-warehouse/iceberg_migrated_alter_test'
                              tblproperties('write.format.default'='parquet', 'iceberg.catalog'=
                              'hadoop.tables');
      
      -- 2024-04-02 00:57:01,060 INFO     MainThread: Started query de4b9324aba8139e:9dedd85800000000
      -- executing against localhost:21000
      
      alter table test_migrated_table_field_id_resolution_b59d79db.iceberg_migrated_alter_test set tblproperties ('external.table.purge'=
                              'True');;
      
      -- 2024-04-02 00:57:05,315 INFO     MainThread: Started query fa48f4bc29dcd9c2:029fc12200000000
      Picked up JAVA_TOOL_OPTIONS:  -javaagent:/data/jenkins/workspace/impala-asf-master-exhaustive-release/repos/Impala/fe/target/dependency/jamm-0.4.0.jar
      Picked up JAVA_TOOL_OPTIONS:  -javaagent:/data/jenkins/workspace/impala-asf-master-exhaustive-release/repos/Impala/fe/target/dependency/jamm-0.4.0.jar
      -- executing against localhost:21000
      
      create external table test_migrated_table_field_id_resolution_b59d79db.iceberg_migrated_complex_test stored as iceberg location '/test-warehouse/iceberg_migrated_complex_test'
                              tblproperties('write.format.default'='parquet', 'iceberg.catalog'=
                              'hadoop.tables');
      
      -- 2024-04-02 00:57:08,872 INFO     MainThread: Started query ca4d76bb6365d3e5:21c23ea100000000
      -- executing against localhost:21000
      
      alter table test_migrated_table_field_id_resolution_b59d79db.iceberg_migrated_complex_test set tblproperties ('external.table.purge'=
                              'True');;
      
      -- 2024-04-02 00:57:15,335 INFO     MainThread: Started query a0438b2e329f8764:082bf21e00000000
      Picked up JAVA_TOOL_OPTIONS:  -javaagent:/data/jenkins/workspace/impala-asf-master-exhaustive-release/repos/Impala/fe/target/dependency/jamm-0.4.0.jar
      Picked up JAVA_TOOL_OPTIONS:  -javaagent:/data/jenkins/workspace/impala-asf-master-exhaustive-release/repos/Impala/fe/target/dependency/jamm-0.4.0.jar
      -- executing against localhost:21000
      
      create external table test_migrated_table_field_id_resolution_b59d79db.iceberg_migrated_alter_test_orc stored as iceberg location '/test-warehouse/iceberg_migrated_alter_test_orc'
                              tblproperties('write.format.default'='orc', 'iceberg.catalog'=
                              'hadoop.tables');
      
      -- 2024-04-02 00:57:19,090 INFO     MainThread: Started query bf4c638006e47ea6:46448d0700000000
      

      Attachments

        Activity

          People

            stigahuang Quanlong Huang
            baggio000 Yida Wu
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: