Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
ghx-label-9
Description
Testcase test_migrated_table_field_id_resolution fails at exhaustive release build with following messages:
Regression
query_test.test_iceberg.TestIcebergTable.test_migrated_table_field_id_resolution[protocol: beeswax | exec_option: {'test_replan': 1, 'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': True, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: parquet/none] (from pytest)
Error Message
query_test/test_iceberg.py:266: in test_migrated_table_field_id_resolution "iceberg_migrated_alter_test_orc", "orc") common/file_utils.py:68: in create_iceberg_table_from_directory file_format)) common/impala_connection.py:215: in execute fetch_profile_after_close=fetch_profile_after_close) beeswax/impala_beeswax.py:191: in execute handle = self.__execute_query(query_string.strip(), user=user) beeswax/impala_beeswax.py:384: in __execute_query self.wait_for_finished(handle) beeswax/impala_beeswax.py:405: in wait_for_finished raise ImpalaBeeswaxException("Query aborted:" + error_log, None) E ImpalaBeeswaxException: ImpalaBeeswaxException: E Query aborted:ImpalaRuntimeException: Error making 'createTable' RPC to Hive Metastore: E CAUSED BY: IcebergTableLoadingException: Table does not exist at location: hdfs://localhost:20500/test-warehouse/iceberg_migrated_alter_test_orc Stacktrace query_test/test_iceberg.py:266: in test_migrated_table_field_id_resolution "iceberg_migrated_alter_test_orc", "orc") common/file_utils.py:68: in create_iceberg_table_from_directory file_format)) common/impala_connection.py:215: in execute fetch_profile_after_close=fetch_profile_after_close) beeswax/impala_beeswax.py:191: in execute handle = self.__execute_query(query_string.strip(), user=user) beeswax/impala_beeswax.py:384: in __execute_query self.wait_for_finished(handle) beeswax/impala_beeswax.py:405: in wait_for_finished raise ImpalaBeeswaxException("Query aborted:" + error_log, None) E ImpalaBeeswaxException: ImpalaBeeswaxException: E Query aborted:ImpalaRuntimeException: Error making 'createTable' RPC to Hive Metastore: E CAUSED BY: IcebergTableLoadingException: Table does not exist at location: hdfs://localhost:20500/test-warehouse/iceberg_migrated_alter_test_orc
Standard Error
SET client_identifier=query_test/test_iceberg.py::TestIcebergTable::()::test_migrated_table_field_id_resolution[protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':True;'abort_on_error':1;'exec_single_; SET sync_ddl=False; -- executing against localhost:21000 DROP DATABASE IF EXISTS `test_migrated_table_field_id_resolution_b59d79db` CASCADE; -- 2024-04-02 00:56:55,137 INFO MainThread: Started query f34399a8b7cddd67:031a3b9600000000 SET client_identifier=query_test/test_iceberg.py::TestIcebergTable::()::test_migrated_table_field_id_resolution[protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':True;'abort_on_error':1;'exec_single_; SET sync_ddl=False; -- executing against localhost:21000 CREATE DATABASE `test_migrated_table_field_id_resolution_b59d79db`; -- 2024-04-02 00:56:57,302 INFO MainThread: Started query 94465af69907eac5:e33f17e000000000 -- 2024-04-02 00:56:57,353 INFO MainThread: Created database "test_migrated_table_field_id_resolution_b59d79db" for test ID "query_test/test_iceberg.py::TestIcebergTable::()::test_migrated_table_field_id_resolution[protocol: beeswax | exec_option: {'test_replan': 1, 'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': True, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: parquet/none]" Picked up JAVA_TOOL_OPTIONS: -javaagent:/data/jenkins/workspace/impala-asf-master-exhaustive-release/repos/Impala/fe/target/dependency/jamm-0.4.0.jar Picked up JAVA_TOOL_OPTIONS: -javaagent:/data/jenkins/workspace/impala-asf-master-exhaustive-release/repos/Impala/fe/target/dependency/jamm-0.4.0.jar -- executing against localhost:21000 create external table test_migrated_table_field_id_resolution_b59d79db.iceberg_migrated_alter_test stored as iceberg location '/test-warehouse/iceberg_migrated_alter_test' tblproperties('write.format.default'='parquet', 'iceberg.catalog'= 'hadoop.tables'); -- 2024-04-02 00:57:01,060 INFO MainThread: Started query de4b9324aba8139e:9dedd85800000000 -- executing against localhost:21000 alter table test_migrated_table_field_id_resolution_b59d79db.iceberg_migrated_alter_test set tblproperties ('external.table.purge'= 'True');; -- 2024-04-02 00:57:05,315 INFO MainThread: Started query fa48f4bc29dcd9c2:029fc12200000000 Picked up JAVA_TOOL_OPTIONS: -javaagent:/data/jenkins/workspace/impala-asf-master-exhaustive-release/repos/Impala/fe/target/dependency/jamm-0.4.0.jar Picked up JAVA_TOOL_OPTIONS: -javaagent:/data/jenkins/workspace/impala-asf-master-exhaustive-release/repos/Impala/fe/target/dependency/jamm-0.4.0.jar -- executing against localhost:21000 create external table test_migrated_table_field_id_resolution_b59d79db.iceberg_migrated_complex_test stored as iceberg location '/test-warehouse/iceberg_migrated_complex_test' tblproperties('write.format.default'='parquet', 'iceberg.catalog'= 'hadoop.tables'); -- 2024-04-02 00:57:08,872 INFO MainThread: Started query ca4d76bb6365d3e5:21c23ea100000000 -- executing against localhost:21000 alter table test_migrated_table_field_id_resolution_b59d79db.iceberg_migrated_complex_test set tblproperties ('external.table.purge'= 'True');; -- 2024-04-02 00:57:15,335 INFO MainThread: Started query a0438b2e329f8764:082bf21e00000000 Picked up JAVA_TOOL_OPTIONS: -javaagent:/data/jenkins/workspace/impala-asf-master-exhaustive-release/repos/Impala/fe/target/dependency/jamm-0.4.0.jar Picked up JAVA_TOOL_OPTIONS: -javaagent:/data/jenkins/workspace/impala-asf-master-exhaustive-release/repos/Impala/fe/target/dependency/jamm-0.4.0.jar -- executing against localhost:21000 create external table test_migrated_table_field_id_resolution_b59d79db.iceberg_migrated_alter_test_orc stored as iceberg location '/test-warehouse/iceberg_migrated_alter_test_orc' tblproperties('write.format.default'='orc', 'iceberg.catalog'= 'hadoop.tables'); -- 2024-04-02 00:57:19,090 INFO MainThread: Started query bf4c638006e47ea6:46448d0700000000