Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-2948

Crash: impala::UnionNode::Prepare (when optimize_partition_key_scans set to true)

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • Impala 2.5.0
    • Impala 2.5.0
    • Frontend
    • DB: functional

    Description

      This crash can be triggered by starting impala cluster with the following command:

      start-impala-cluster.py --impalad_args="--default_query_options=optimize_partition_key_scans=1"
      

      Query:

      SELECT
      COALESCE(a4.int_col_1, a4.bigint_col, a4.bigint_col) AS int_col
      FROM (
      SELECT
      (a3.int_col) + (a3.int_col) AS int_col_1,
      a1.bigint_col,
      a3.int_col,
      (a1.month) + (a1.year) AS int_col_2
      FROM alltypestiny a1
      INNER JOIN (
      SELECT
      (697) != (COUNT(COALESCE(a2.day, a2.int_col, a2.tinyint_col))) AS boolean_col,
      COALESCE(MIN(a2.year), 972, -416) AS int_col
      FROM alltypesagg a2
      ) a3 ON ((a3.int_col) = (a1.month)) AND ((a3.int_col) = (a1.int_col))
      GROUP BY
      (a3.int_col) + (a3.int_col),
      a1.bigint_col,
      a3.int_col,
      (a1.month) + (a1.year)
      HAVING
      (a3.int_col) IS DISTINCT FROM (SUM(a3.int_col))
      ) a4
      WHERE
      (a4.int_col_1) IN (a4.int_col, a4.int_col_1)
      

      Stack Trace:

      google::DumpStackTraceAndExit() ()
      google::LogMessage::Fail() ()
      google::LogMessage::SendToLog() ()
      google::LogMessage::Flush() ()
      google::LogMessageFatal::~LogMessageFatal() ()
      impala::UnionNode::Prepare (this=0x13e10d00, state=0x23f7cd00) at /home/dev/Impala/be/src/exec/union-node.cc:70
      impala::ExecNode::Prepare (this=0xe73c900, state=0x23f7cd00) at /home/dev/Impala/be/src/exec/exec-node.cc:153
      impala::PartitionedAggregationNode::Prepare (this=0xe73c900, state=0x23f7cd00) at /home/dev/Impala/be/src/exec/partitioned-aggregation-node.cc:107
      impala::PlanFragmentExecutor::Prepare (this=0x13806030, request=...) at /home/dev/Impala/be/src/runtime/plan-fragment-executor.cc:245
      impala::FragmentMgr::FragmentExecState::Prepare (this=0x13805e00) at /home/dev/Impala/be/src/service/fragment-exec-state.cc:44
      impala::FragmentMgr::FragmentThread (this=0xe985d40, fragment_instance_id=...) at /home/dev/Impala/be/src/service/fragment-mgr.cc:85
      boost::_mfi::mf1::operator() (this=0xf8d6750, p=0xe985d40, a1=...) at /home/dev/Impala/toolchain/boost-1.57.0/include/boost/bind/mem_fn_template.hpp:165
      boost::_bi::list2, boost::_bi::value >::operator(), boost::_bi::list0> (this=0xf8d6760, f=..., a=...) at /home/dev/Impala/toolchain/boost-1.57.0/include/boost/bind/bind.hpp:313
      boost::_bi::bind_t, boost::_bi::list2, boost::_bi::value > >::operator() (this=0xf8d6750) at /home/dev/Impala/toolchain/boost-1.57.0/include/boost/bind/bind_template.hpp:20
      boost::detail::function::void_function_obj_invoker0, boost::_bi::list2, boost::_bi::value > >, void>::invoke (function_obj_ptr=...) at /home/dev/Impala/toolchain/boost-1.57.0/include/boost/function/function_template.hpp:153
      boost::function0::operator() (this=0x7f4e36d30de0) at /home/dev/Impala/toolchain/boost-1.57.0/include/boost/function/function_template.hpp:767
      impala::Thread::SuperviseThread(std::string const&, std::string const&, boost::function, impala::Promise*) (name=..., category=..., functor=..., thread_started=0x7f4e3c63ab90) at /home/dev/Impala/be/src/util/thread.cc:316
      boost::_bi::list4, boost::_bi::value, boost::_bi::value >, boost::_bi::value*> >::operator(), impala::Promise*), boost::_bi::list0>(boost::_bi::type, void (*&)(std::string const&, std::string const&, boost::function, impala::Promise*), boost::_bi::list0&, int) (this=0x1baa47c0, f=@0x1baa47b8: 0x15672a2 , impala::Promise*)>, a=...) at /home/dev/Impala/toolchain/boost-1.57.0/include/boost/bind/bind.hpp:457
      boost::_bi::bind_t, impala::Promise*), boost::_bi::list4, boost::_bi::value, boost::_bi::value >, boost::_bi::value*> > >::operator()() (this=0x1baa47b8) at /home/dev/Impala/toolchain/boost-1.57.0/include/boost/bind/bind_template.hpp:20
      boost::detail::thread_data, impala::Promise*), boost::_bi::list4, boost::_bi::value, boost::_bi::value >, boost::_bi::value*> > > >::run() (this=0x1baa4600) at /home/dev/Impala/toolchain/boost-1.57.0/include/boost/thread/detail/thread.hpp:116
      thread_proxy ()
      start_thread (arg=0x7f4e36d31700) at pthread_create.c:312
      clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
      

      Attachments

        Activity

          People

            kwho Michael Ho
            tarasbob Taras Bobrovytsky
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: