Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-993

DCHECK in decimal-operators.cc while comparing different Decimal types.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Impala 1.4
    • None
    • None

    Description

      I see this ~80% of the time.

      Table (10,000 rows, all distinct values for non boolean columns):

      +----------------+----------------+---------+
      | name           | type           | comment |
      +----------------+----------------+---------+
      | string_col_1   | string         |         |
      | boolean_col_2  | boolean        |         |
      | smallint_col_3 | smallint       |         |
      | float_col_4    | decimal(16,8)  |         |
      | float_col_5    | decimal(16,8)  |         |
      | double_col_6   | decimal(32,16) |         |
      +----------------+----------------+---------+
      

      This query makes it fail (any comparison operator will trigger it): select count where float_col_4

      {<,>,=,!=,<=,>=}

      double_col_6;

      Note that I am reliably able to run counts and scans over the individual columns. Additionally, this only happens when the Decimal types have different scale and precision.

      impalad-error-log.txt

      F0509 14:17:30.293581 32414 decimal-operators.cc:270] Check failed: e->GetNumChildren() == 2 (1 vs. 2)
      *** Check failure stack trace: ***
          @          0x1db33dd  google::LogMessage::Fail()
          @          0x1db5b7f  google::LogMessage::SendToLog()
          @          0x1db2fcb  google::LogMessage::Flush()
          @          0x1db640d  google::LogMessageFatal::~LogMessageFatal()
          @          0x10d4b9f  impala::DecimalOperators::RoundDecimalNegativeScale()
          @          0x10d5087  impala::DecimalOperators::RoundDecimal()
          @          0x10d54ae  impala::DecimalOperators::Cast_decimal_decimal()
          @           0xde065f  impala::Expr::GetValue()
          @          0x10d8407  impala::DecimalOperators::Gt_decimal_decimal()
          @           0xde065f  impala::Expr::GetValue()
          @          0x124ff8f  impala::ExecNode::EvalConjuncts()
          @          0x1310f23  impala::HdfsScanner::WriteCompleteTuple()
          @          0x1313b61  impala::HdfsScanner::WriteAlignedTuples()
          @          0x12a31fe  impala::HdfsTextScanner::WriteFields()
          @          0x12a1d75  impala::HdfsTextScanner::ProcessRange()
          @          0x12a0a3c  impala::HdfsTextScanner::ProcessSplit()
          @          0x126a67b  impala::HdfsScanNode::ScannerThread()
          @          0x127e162  boost::_mfi::mf0<>::operator()()
          @          0x127d8a6  boost::_bi::list1<>::operator()<>()
          @          0x127c6b1  boost::_bi::bind_t<>::operator()()
          @          0x127b0d5  boost::detail::function::void_function_obj_invoker0<>::invoke()
          @           0xe3a75a  boost::function0<>::operator()()
          @          0x100f5dc  impala::Thread::SuperviseThread()
          @          0x101715c  boost::_bi::list4<>::operator()<>()
          @          0x10170a5  boost::_bi::bind_t<>::operator()()
          @          0x1017038  boost::detail::thread_data<>::run()
          @     0x7f6af6398ce9  (unknown)
          @     0x7f6af6176e9a  start_thread
          @     0x7f6af40bd3fd  (unknown)
      

      Attachments

        Activity

          People

            nong_impala_60e1 Nong Li
            ishaan Ishaan Joshi
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: