Details
-
Bug
-
Status: Resolved
-
Critical
-
Resolution: Cannot Reproduce
-
Impala 2.3.0
-
None
-
None
-
impalad version 2.3.0-cdh5-INTERNAL DEBUG (build ad817a337f2223253139ebc0ada3c1c4a9fde55d)
Built on Tue, 13 Oct 2015 21:48:43 PST
Description
The kerberized stress test run crashed in an unusual way. The bt from gdb doesn't show anything useful. There is an hs_err file and I think it indicates that the crash came from a java call.
(Note, this run may have been off the 2.3.x branch instead of 2.3.0)
Stack: [0x00007f327aa7c000,0x00007f327b47d000], sp=0x00007f327b477be8, free space=10222k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) j org.apache.thrift.transport.TMemoryInputTransport.reset([B)V+0 j org.apache.thrift.TDeserializer.deserialize(Lorg/apache/thrift/TBase;[B)V+5 J 2072 C2 com.cloudera.impala.service.FeSupport.EvalPredicateBatch(Ljava/util/ArrayList;Lcom/cloudera/impala/thrift/TQueryCtx;)Lcom/cloudera/impala/thrift/TResultRow; (154 bytes) @ 0x00007f32f0784758 [0x00007f32f0783820+0xf38] J 2025 C2 com.cloudera.impala.planner.HdfsPartitionFilter.getMatchingPartitionIds(Ljava/util/ArrayList;Lcom/cloudera/impala/analysis/Analyzer;)Ljava/util/HashSet; (186 bytes) @ 0x00 007f32f0726784 [0x00007f32f07250a0+0x16e4] J 2063 C2 com.cloudera.impala.planner.HdfsScanNode.evalPartitionFiltersInBe(Ljava/util/List;Ljava/util/HashSet;Lcom/cloudera/impala/analysis/Analyzer;)V (206 bytes) @ 0x00007f32f076 b5cc [0x00007f32f076ae00+0x7cc] J 1975 C2 com.cloudera.impala.planner.HdfsScanNode.prunePartitions(Lcom/cloudera/impala/analysis/Analyzer;)V (415 bytes) @ 0x00007f32f069f100 [0x00007f32f069e820+0x8e0] j com.cloudera.impala.planner.HdfsScanNode.init(Lcom/cloudera/impala/analysis/Analyzer;)V+53 j com.cloudera.impala.planner.SingleNodePlanner.createScanNode(Lcom/cloudera/impala/analysis/Analyzer;Lcom/cloudera/impala/analysis/TableRef;)Lcom/cloudera/impala/planner/PlanNode; +40 J 2227 C2 com.cloudera.impala.planner.SingleNodePlanner.createTableRefsPlan(Ljava/util/List;Ljava/util/List;ZLcom/cloudera/impala/analysis/Analyzer;)Lcom/cloudera/impala/planner/Pla nNode; (203 bytes) @ 0x00007f32f0883a88 [0x00007f32f0883900+0x188] j com.cloudera.impala.planner.SingleNodePlanner.createSelectPlan(Lcom/cloudera/impala/analysis/SelectStmt;Lcom/cloudera/impala/analysis/Analyzer;)Lcom/cloudera/impala/planner/PlanN ode;+168 j com.cloudera.impala.planner.SingleNodePlanner.createQueryPlan(Lcom/cloudera/impala/analysis/QueryStmt;Lcom/cloudera/impala/analysis/Analyzer;Z)Lcom/cloudera/impala/planner/PlanNo de;+31 j com.cloudera.impala.planner.SingleNodePlanner.createSingleNodePlan()Lcom/cloudera/impala/planner/PlanNode;+87 j com.cloudera.impala.planner.Planner.createPlan()Ljava/util/ArrayList;+25 J 2097 C2 com.cloudera.impala.service.Frontend.createExecRequest(Lcom/cloudera/impala/thrift/TQueryCtx;Ljava/lang/StringBuilder;)Lcom/cloudera/impala/thrift/TExecRequest; (1421 byte s) @ 0x00007f32f07be91c [0x00007f32f07bdc20+0xcfc] j com.cloudera.impala.service.JniFrontend.createExecRequest([B)[B+30 v ~StubRoutines::call_stub V [libjvm.so+0x5ffb65] JavaCalls::call_helper(JavaValue*, methodHandle*, JavaCallArguments*, Thread*)+0x365 V [libjvm.so+0x5fe5c8] JavaCalls::call(JavaValue*, methodHandle, JavaCallArguments*, Thread*)+0x28 V [libjvm.so+0x638dd4] jni_invoke_nonstatic(JNIEnv_*, JavaValue*, _jobject*, JNICallType, _jmethodID*, JNI_ArgumentPusher*, Thread*)+0x2b4 V [libjvm.so+0x649ab9] jni_CallObjectMethodV+0xe9 C [impalad+0xb47393] JNIEnv_::CallObjectMethod(_jobject*, _jmethodID*, ...)+0xe3 C [impalad+0xe6fb55] impala::Status impala::JniUtil::CallJniMethod<impala::TQueryCtx, impala::TExecRequest>(_jobject* const&, _jmethodID* const&, impala::TQueryCtx const&, impala::TExecRequest*)+0x17d C [impalad+0xe6bfba] impala::Frontend::GetExecRequest(impala::TQueryCtx const&, impala::TExecRequest*)+0x44 C [impalad+0xe8acd1] impala::ImpalaServer::ExecuteInternal(impala::TQueryCtx const&, boost::shared_ptr<impala::ImpalaServer::SessionState>, bool*, boost::shared_ptr<impala::ImpalaServer::QueryExecState>*)+0x4b3 C [impalad+0xe8a713] impala::ImpalaServer::Execute(impala::TQueryCtx*, boost::shared_ptr<impala::ImpalaServer::SessionState>, boost::shared_ptr<impala::ImpalaServer::QueryExecState>*)+0x11b C [impalad+0xee5d31] impala::ImpalaServer::ExecuteStatement(apache::hive::service::cli::thrift::TExecuteStatementResp&, apache::hive::service::cli::thrift::TExecuteStatementReq const&)+0xf87 C [impalad+0x10be72f] apache::hive::service::cli::thrift::TCLIServiceProcessor::process_ExecuteStatement(int, apache::thrift::protocol::TProtocol*, apache::thrift::protocol::TProtocol*, void*)+0x247 C [impalad+0x10bcc50] apache::hive::service::cli::thrift::TCLIServiceProcessor::dispatchCall(apache::thrift::protocol::TProtocol*, apache::thrift::protocol::TProtocol*, std::string const&, int, void*)+0x394 C [impalad+0x109397f] impala::ImpalaHiveServer2ServiceProcessor::dispatchCall(apache::thrift::protocol::TProtocol*, apache::thrift::protocol::TProtocol*, std::string const&, int, void*)+0x9b C [impalad+0xe9841a] apache::thrift::TDispatchProcessor::process(boost::shared_ptr<apache::thrift::protocol::TProtocol>, boost::shared_ptr<apache::thrift::protocol::TProtocol>, void*)+0xd6
I'll post the core/log files a little later.