Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3048 Address Runtime filter performance regressions
  3. IMPALA-3049

Address cache misses introduced Runtime filter counters

    XMLWordPrintableJSON

Details

    Description

      Call stack

      CPU Time
      1 of 1: 100.0% (212.722s of 212.722s)
      impalad ! std::vector<long, std::allocator<long>>::operator[] - stl_vector.h
      impalad ! ReadSlot<false> + 0x8b - hdfs-parquet-scanner.cc:756
      impalad ! ReadValue<false> + 0x3b - hdfs-parquet-scanner.cc:687
      impalad ! impala::HdfsParquetScanner::ScalarColumnReader<long, (bool)1>::ReadNonRepeatedValue + 0x88 - hdfs-parquet-scanner.cc:754
      impalad ! ReadRow<false> + 0x5c - hdfs-parquet-scanner.cc:1753
      impalad ! impala::HdfsParquetScanner::AssembleRows<(bool)0, (bool)0> + 0xe8 - hdfs-parquet-scanner.cc:1654
      impalad ! impala::HdfsParquetScanner::ProcessSplit + 0x4fa - hdfs-parquet-scanner.cc:1596
      impalad ! impala::HdfsScanNode::ProcessSplit + 0x365 - hdfs-scan-node.cc:1163
      impalad ! impala::HdfsScanNode::ScannerThread + 0x5cb - hdfs-scan-node.cc:1043
      impalad ! boost::function0<void>::operator() + 0x1a - function_template.hpp:767
      impalad ! impala::Thread::SuperviseThread + 0x20c - thread.cc:316
      impalad ! operator()<void (*)(const std::basic_string<char>&, const std::basic_string<char>&, boost::function<void()>, impala::Promise<long int>*), boost::_bi::list0> + 0x5a - bind.hpp:457
      impalad ! boost::_bi::bind_t<void, void (*)(std::string const&, std::string const&, boost::function<void (void)>, impala::Promise<long>*), boost::_bi::list4<boost::_bi::value<std::string>, boost::_bi::value<std::string>, boost::_bi::value<boost::function<void (void)>>, boost::_bi::value<impala::Promise<long>*>>>::operator() - bind_template.hpp:20
      impalad ! boost::detail::thread_data<boost::_bi::bind_t<void, void (*)(std::string const&, std::string const&, boost::function<void (void)>, impala::Promise<long>*), boost::_bi::list4<boost::_bi::value<std::string>, boost::_bi::value<std::string>, boost::_bi::value<boost::function<void (void)>>, boost::_bi::value<impala::Promise<long>*>>>>::run + 0x19 - thread.hpp:116
      impalad ! thread_proxy + 0xd9 - [unknown source file]
      libpthread.so.0 ! start_thread + 0xd0 - [unknown source file]
      libc.so.6 ! clone + 0x6c - [unknown source file]
      

      Offending code

          for (int i = 0; i < filter_ctxs_.size(); ++i) {
            if (!filter_enabled_[i]) continue;
            ++filter_rows_total_possible_[i];
      

      Attachments

        Activity

          People

            henryr Henry Robinson
            mmokhtar Mostafa Mokhtar
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: