Error Message
ImpalaBeeswaxException: ImpalaBeeswaxException: INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'> MESSAGE: AnalysisException: Cannot analyze Kudu table 't': Error determining if Kudu's integration with the Hive Metastore is enabled: cannot complete before timeout: KuduRpc(method=getHiveMetastoreConfig, tablet=null, attempt=97, TimeoutTracker(timeout=180000, elapsed=178723), Trace Summary(177842 ms): Sent(0), Received(0), Delayed(96), MasterRefresh(0), AuthRefresh(0), Truncated: false Delayed: (UNKNOWN, [ getHiveMetastoreConfig, 96 ]))
Stacktrace
custom_cluster/test_kudu.py:150: in test_create_managed_kudu_tables
self.run_test_case('QueryTest/kudu_create', vector, use_db=unique_database)
common/impala_test_suite.py:621: in run_test_case
result = exec_fn(query, user=test_section.get('USER', '').strip() or None)
common/impala_test_suite.py:556: in __exec_in_impala
result = self.__execute_query(target_impalad_client, query, user=user)
common/impala_test_suite.py:893: in __execute_query
return impalad_client.execute(query, user=user)
common/impala_connection.py:205: in execute
return self.__beeswax_client.execute(sql_stmt, user=user)
beeswax/impala_beeswax.py:187: in execute
handle = self.__execute_query(query_string.strip(), user=user)
beeswax/impala_beeswax.py:362: in __execute_query
handle = self.execute_query_async(query_string, user=user)
beeswax/impala_beeswax.py:356: in execute_query_async
handle = self.__do_rpc(lambda: self.imp_service.query(query,))
beeswax/impala_beeswax.py:519: in __do_rpc
raise ImpalaBeeswaxException(self.__build_error_message(b), b)
E ImpalaBeeswaxException: ImpalaBeeswaxException:
E INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
E MESSAGE: AnalysisException: Cannot analyze Kudu table 't': Error determining if Kudu's integration with the Hive Metastore is enabled: cannot complete before timeout: KuduRpc(method=getHiveMetastoreConfig, tablet=null, attempt=97, TimeoutTracker(timeout=180000, elapsed=178723), Trace Summary(177842 ms): Sent(0), Received(0), Delayed(96), MasterRefresh(0), AuthRefresh(0), Truncated: false
E Delayed: (UNKNOWN, [ getHiveMetastoreConfig, 96 ]))
Standard Output
Stopping kudu
Starting kudu (Web UI - http://localhost:8051)
Standard Error
-- 2019-10-31 12:46:18,353 INFO MainThread: Starting cluster with command: /data/jenkins/workspace/impala-asf-master-exhaustive/repos/Impala/bin/start-impala-cluster.py '--state_store_args=--statestore_update_frequency_ms=50 --statestore_priority_update_frequency_ms=50 --statestore_heartbeat_frequency_ms=50' --cluster_size=3 --num_coordinators=3 --log_dir=/data/jenkins/workspace/impala-asf-master-exhaustive/repos/Impala/logs/custom_cluster_tests --log_level=1 '--impalad_args=-kudu_client_rpc_timeout_ms=30000 ' '--state_store_args=None ' --impalad_args=--default_query_options=
12:46:18 MainThread: Found 0 impalad/0 statestored/0 catalogd process(es)
12:46:18 MainThread: Starting State Store logging to /data/jenkins/workspace/impala-asf-master-exhaustive/repos/Impala/logs/custom_cluster_tests/statestored.INFO
12:46:18 MainThread: Starting Catalog Service logging to /data/jenkins/workspace/impala-asf-master-exhaustive/repos/Impala/logs/custom_cluster_tests/catalogd.INFO
12:46:18 MainThread: Starting Impala Daemon logging to /data/jenkins/workspace/impala-asf-master-exhaustive/repos/Impala/logs/custom_cluster_tests/impalad.INFO
12:46:18 MainThread: Starting Impala Daemon logging to /data/jenkins/workspace/impala-asf-master-exhaustive/repos/Impala/logs/custom_cluster_tests/impalad_node1.INFO
12:46:18 MainThread: Starting Impala Daemon logging to /data/jenkins/workspace/impala-asf-master-exhaustive/repos/Impala/logs/custom_cluster_tests/impalad_node2.INFO
12:46:21 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
12:46:21 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
12:46:21 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25000
12:46:22 MainThread: Waiting for num_known_live_backends=3. Current value: 0
12:46:23 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
12:46:23 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25000
12:46:23 MainThread: Waiting for num_known_live_backends=3. Current value: 0
12:46:24 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
12:46:24 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25000
12:46:24 MainThread: num_known_live_backends has reached value: 3
12:46:24 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
12:46:24 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25001
12:46:24 MainThread: num_known_live_backends has reached value: 3
12:46:25 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
12:46:25 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25002
12:46:25 MainThread: num_known_live_backends has reached value: 3
12:46:25 MainThread: Impala Cluster Running with 3 nodes (3 coordinators, 3 executors).
-- 2019-10-31 12:46:25,716 DEBUG MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
-- 2019-10-31 12:46:25,716 INFO MainThread: Getting metric: statestore.live-backends from impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25010
-- 2019-10-31 12:46:25,718 INFO MainThread: Starting new HTTP connection (1): impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com
-- 2019-10-31 12:46:25,719 INFO MainThread: Metric 'statestore.live-backends' has reached desired value: 4
-- 2019-10-31 12:46:25,719 DEBUG MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25000
-- 2019-10-31 12:46:25,720 INFO MainThread: Starting new HTTP connection (1): impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com
-- 2019-10-31 12:46:25,721 INFO MainThread: num_known_live_backends has reached value: 3
-- 2019-10-31 12:46:25,721 DEBUG MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25001
-- 2019-10-31 12:46:25,721 INFO MainThread: Starting new HTTP connection (1): impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com
-- 2019-10-31 12:46:25,722 INFO MainThread: num_known_live_backends has reached value: 3
-- 2019-10-31 12:46:25,723 DEBUG MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25002
-- 2019-10-31 12:46:25,723 INFO MainThread: Starting new HTTP connection (1): impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com
-- 2019-10-31 12:46:25,724 INFO MainThread: num_known_live_backends has reached value: 3
SET client_identifier=custom_cluster/test_kudu.py::TestKuduHMSIntegration::()::test_create_managed_kudu_tables[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thresh;
-- connecting to: localhost:21000
-- connecting to localhost:21050 with impyla
-- 2019-10-31 12:46:25,863 INFO MainThread: Closing active operation
SET client_identifier=custom_cluster/test_kudu.py::TestKuduHMSIntegration::()::test_create_managed_kudu_tables[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thresh;
SET sync_ddl=False;
-- executing against localhost:21000
DROP DATABASE IF EXISTS `test_create_managed_kudu_tables_a8d11828` CASCADE;
-- 2019-10-31 12:46:25,989 INFO MainThread: Started query 654518748d4558d9:09072f1600000000
SET client_identifier=custom_cluster/test_kudu.py::TestKuduHMSIntegration::()::test_create_managed_kudu_tables[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thresh;
SET sync_ddl=False;
-- executing against localhost:21000
CREATE DATABASE `test_create_managed_kudu_tables_a8d11828`;
-- 2019-10-31 12:46:26,408 INFO MainThread: Started query b6472ff2ad59403b:385d4ec500000000
-- 2019-10-31 12:46:26,410 INFO MainThread: Created database "test_create_managed_kudu_tables_a8d11828" for test ID "custom_cluster/test_kudu.py::TestKuduHMSIntegration::()::test_create_managed_kudu_tables[protocol: beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: text/none]"
SET client_identifier=custom_cluster/test_kudu.py::TestKuduHMSIntegration::()::test_create_managed_kudu_tables[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thresh;
-- executing against localhost:21000
use test_create_managed_kudu_tables_a8d11828;
-- 2019-10-31 12:46:26,417 INFO MainThread: Started query c54a078aaf47706a:7be99df800000000
SET client_identifier=custom_cluster/test_kudu.py::TestKuduHMSIntegration::()::test_create_managed_kudu_tables[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thresh;
SET kudu_read_mode=READ_AT_SNAPSHOT;
SET batch_size=0;
SET num_nodes=0;
SET disable_codegen_rows_threshold=0;
SET disable_codegen=False;
SET abort_on_error=1;
SET exec_single_node_rows_threshold=0;
-- 2019-10-31 12:46:26,420 INFO MainThread: Starting new HTTP connection (1): localhost
-- executing against localhost:21000
create table t primary key (id) partition by hash (id) partitions 3
stored as kudu
as select id, int_col from functional.alltypestiny;
Bug
Minor