Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
ghx-label-5
Description
An error is observed in the data-cache exhaustive build in test_read_equality_deletes with following message:
query_test.test_iceberg.TestIcebergV2Table.test_read_equality_deletes[protocol: beeswax | table_format: parquet/none | exec_option: {'test_replan': 1, 'disable_optimized_iceberg_v2_read': 1, 'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0}] (from pytest)
Error Message
query_test/test_iceberg.py:1456: in test_read_equality_deletes self.run_test_case('QueryTest/iceberg-v2-read-equality-deletes', vector) common/impala_test_suite.py:725: in run_test_case result = exec_fn(query, user=test_section.get('USER', '').strip() or None) common/impala_test_suite.py:660: in __exec_in_impala result = self.__execute_query(target_impalad_client, query, user=user) common/impala_test_suite.py:1013: in __execute_query return impalad_client.execute(query, user=user) common/impala_connection.py:215: in execute fetch_profile_after_close=fetch_profile_after_close) beeswax/impala_beeswax.py:191: in execute handle = self.__execute_query(query_string.strip(), user=user) beeswax/impala_beeswax.py:382: in __execute_query handle = self.execute_query_async(query_string, user=user) beeswax/impala_beeswax.py:376: in execute_query_async handle = self.__do_rpc(lambda: self.imp_service.query(query,)) beeswax/impala_beeswax.py:539: in __do_rpc raise ImpalaBeeswaxException(self.__build_error_message(b), b) E ImpalaBeeswaxException: ImpalaBeeswaxException: E INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'> E MESSAGE: ConcurrentModificationException: null
Stacktrace
query_test/test_iceberg.py:1456: in test_read_equality_deletes self.run_test_case('QueryTest/iceberg-v2-read-equality-deletes', vector) common/impala_test_suite.py:725: in run_test_case result = exec_fn(query, user=test_section.get('USER', '').strip() or None) common/impala_test_suite.py:660: in __exec_in_impala result = self.__execute_query(target_impalad_client, query, user=user) common/impala_test_suite.py:1013: in __execute_query return impalad_client.execute(query, user=user) common/impala_connection.py:215: in execute fetch_profile_after_close=fetch_profile_after_close) beeswax/impala_beeswax.py:191: in execute handle = self.__execute_query(query_string.strip(), user=user) beeswax/impala_beeswax.py:382: in __execute_query handle = self.execute_query_async(query_string, user=user) beeswax/impala_beeswax.py:376: in execute_query_async handle = self.__do_rpc(lambda: self.imp_service.query(query,)) beeswax/impala_beeswax.py:539: in __do_rpc raise ImpalaBeeswaxException(self.__build_error_message(b), b) E ImpalaBeeswaxException: ImpalaBeeswaxException: E INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'> E MESSAGE: ConcurrentModificationException: null
Standard Error
SET client_identifier=query_test/test_iceberg.py::TestIcebergV2Table::()::test_read_equality_deletes[protocol:beeswax|table_format:parquet/none|exec_option:{'test_replan':1;'disable_optimized_iceberg_v2_read':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'d; -- connecting to: localhost:21000 -- 2024-04-03 07:04:53,469 INFO MainThread: Could not connect to ('::1', 21000, 0, 0) Traceback (most recent call last): File "/data/jenkins/workspace/impala-asf-master-exhaustive-data-cache/repos/Impala/infra/python/env-gcc10.4.0/lib/python2.7/site-packages/thrift/transport/TSocket.py", line 137, in open handle.connect(sockaddr) File "/data/jenkins/workspace/impala-asf-master-exhaustive-data-cache/Impala-Toolchain/toolchain-packages-gcc10.4.0/python-2.7.16/lib/python2.7/socket.py", line 228, in meth return getattr(self._sock,name)(*args) error: [Errno 111] Connection refused -- connecting to localhost:21050 with impyla -- 2024-04-03 07:04:53,469 INFO MainThread: Could not connect to ('::1', 21050, 0, 0) Traceback (most recent call last): File "/data/jenkins/workspace/impala-asf-master-exhaustive-data-cache/repos/Impala/infra/python/env-gcc10.4.0/lib/python2.7/site-packages/thrift/transport/TSocket.py", line 137, in open handle.connect(sockaddr) File "/data/jenkins/workspace/impala-asf-master-exhaustive-data-cache/Impala-Toolchain/toolchain-packages-gcc10.4.0/python-2.7.16/lib/python2.7/socket.py", line 228, in meth return getattr(self._sock,name)(*args) error: [Errno 111] Connection refused -- 2024-04-03 07:04:53,481 INFO MainThread: Closing active operation -- connecting to localhost:28000 with impyla -- 2024-04-03 07:04:53,497 INFO MainThread: Closing active operation SET client_identifier=query_test/test_iceberg.py::TestIcebergV2Table::()::test_read_equality_deletes[protocol:beeswax|table_format:parquet/none|exec_option:{'test_replan':1;'disable_optimized_iceberg_v2_read':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'d; -- executing against localhost:21000 use functional_parquet; -- 2024-04-03 07:04:53,508 INFO MainThread: Started query 2c4cf2169ce92fb8:83ac1fe100000000 SET client_identifier=query_test/test_iceberg.py::TestIcebergV2Table::()::test_read_equality_deletes[protocol:beeswax|table_format:parquet/none|exec_option:{'test_replan':1;'disable_optimized_iceberg_v2_read':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'d; SET test_replan=1; SET disable_optimized_iceberg_v2_read=1; SET batch_size=0; SET num_nodes=0; SET disable_codegen_rows_threshold=0; SET disable_codegen=False; SET abort_on_error=1; SET exec_single_node_rows_threshold=0; -- 2024-04-03 07:04:53,508 INFO MainThread: Loading query test file: /data/jenkins/workspace/impala-asf-master-exhaustive-data-cache/repos/Impala/testdata/workloads/functional-query/queries/QueryTest/iceberg-v2-read-equality-deletes.test -- executing against localhost:21000 select * from functional_parquet.iceberg_v2_delete_equality; -- 2024-04-03 07:05:00,815 INFO MainThread: Started query 5f4a1d542dd45959:34b421c700000000 -- executing against localhost:21000 select * from functional_parquet.iceberg_v2_delete_equality for system_version as of 5763349507283783091; -- 2024-04-03 07:05:01,068 INFO MainThread: Started query 0b4eb99bbd973898:e04fbb0800000000 -- executing against localhost:21000 select * from functional_parquet.iceberg_v2_delete_equality for system_time as of now(); -- 2024-04-03 07:05:01,222 INFO MainThread: Started query d1418660c4de19d2:b3d126b500000000 -- executing against localhost:21000 select *, ICEBERG__DATA__SEQUENCE__NUMBER from functional_parquet.iceberg_v2_delete_equality_nulls; -- 2024-04-03 07:05:06,830 INFO MainThread: Started query c940cf88ff46041f:36ca8a9b00000000 -- executing against localhost:21000 select *, ICEBERG__DATA__SEQUENCE__NUMBER from functional_parquet.iceberg_v2_delete_equality_nulls for system_version as of 4346796256488077976; -- 2024-04-03 07:05:06,999 INFO MainThread: Started query 2d40d5be29152295:902d277600000000 -- executing against localhost:21000 select * from functional_parquet.iceberg_v2_delete_both_eq_and_pos; -- 2024-04-03 07:05:07,058 INFO MainThread: Started query 63435f4ab3c2fe59:6687337600000000 -- executing against localhost:21000 select * from functional_parquet.iceberg_v2_delete_equality_partitioned order by d, s; -- 2024-04-03 07:05:07,325 INFO MainThread: Started query 04433e3771af06b9:1c23d90600000000 -- executing against localhost:21000 select * from functional_parquet.iceberg_v2_delete_equality_multi_eq_ids; -- 2024-04-03 07:05:12,858 INFO MainThread: Started query 544e0e67584e7565:fb3dfe1700000000 -- executing against localhost:21000 select * from functional_parquet.iceberg_v2_delete_equality_multi_eq_ids for system_version as of 4077234998626563290; -- 2024-04-03 07:05:13,372 INFO MainThread: Started query 2943018f515fc971:8f38a21b00000000 -- executing against localhost:21000 select * from functional_parquet.iceberg_v2_delete_equality_multi_eq_ids for system_version as of 8127619959873391049; -- 2024-04-03 07:05:13,537 INFO MainThread: Started query b54ea6c2f88c161c:d7044f7100000000 -- executing against localhost:21000 select * from functional_parquet.iceberg_v2_delete_pos_and_multi_eq_ids; -- 2024-04-03 07:05:18,873 INFO MainThread: Started query 434ca4be277c05c3:4e895df600000000 -- executing against localhost:21000 select * from functional_parquet.iceberg_v2_delete_pos_and_multi_eq_ids for system_version as of 152862018760071153; -- 2024-04-03 07:05:19,231 INFO MainThread: Started query e94df499c59205ee:1fa5394100000000 -- executing against localhost:21000 select * from functional_parquet.iceberg_v2_equality_delete_schema_evolution;