Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5889

Segmentation fault in ScannerContext::Stream::GetBytesInternal(long, unsigned char**, bool, long*)

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Duplicate
    • Impala 2.8.0, Impala 2.9.0
    • None
    • Backend
    • ghx-label-8

    Description

      I found several crashes like this one while looking at minidumps from a private cluster. Below is the stack of the crashing thread. I'll also attach a full resolved minidump. I suspect that this happened while Impala was scanning an Avro file while it was being overwritten. I tried to reproduce this but couldn't do so. I also suspect this could be related to IMPALA-4223.

      Crash reason:  SIGSEGV
Crash address: 0x7fc302e12000
Process uptime: not available

Thread 587 (crashed)
 0  libc-2.12.so + 0x8995f
    Found by: given as instruction pointer in context
 1  impalad!impala::ScannerContext::Stream::GetBytesInternal(long, unsigned char**, bool, long*) [string-buffer.h : 54 + 0x12]
    Found by: stack scanning
 2  impalad!impala::BaseSequenceScanner::SkipToSync(unsigned char const*, int) [scanner-context.inline.h : 55 + 0x19]
    Found by: call frame info
 3  impalad!impala::BaseSequenceScanner::ProcessSplit() [base-sequence-scanner.cc : 199 + 0x10]
    Found by: call frame info
 4  impalad!impala::HdfsScanNode::ProcessSplit(std::vector<impala::FilterContext, std::allocator<impala::FilterContext> > const&, impala::DiskIoMgr::ScanRange*) [hdfs-scan-node.cc : 526 + 0x11]
    Found by: call frame info
 5  impalad!impala::HdfsScanNode::ScannerThread() [hdfs-scan-node.cc : 417 + 0x18]
    Found by: call frame info
 6  impalad!impala::Thread::SuperviseThread(std::string const&, std::string const&, boost::function<void ()>, impala::Promise<long>*) [function_template.hpp : 767 + 0x7]
    Found by: call frame info
 7  impalad!boost::detail::thread_data<boost::_bi::bind_t<void, void (*)(std::string const&, std::string const&, boost::function<void ()>, impala::Promise<long>*), boost::_bi::list4<boost::_bi::value<std::string>, boost::_bi::value<std::string>, boost::_bi::value<boost::function<void ()> >, boost::_bi::value<impala::Promise<long>*> > > >::run() [bind.hpp : 457 + 0x6]
    Found by: call frame info
 8  impalad!thread_proxy + 0xda
    Found by: call frame info
 9  libpthread-2.12.so + 0x7aa1
    Found by: call frame info
10  libc-2.12.so + 0xe893d
    Found by: stack scanning

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-5890 Segmentation fault in ScannerContext::Stream::GetBytesInternal(long, unsigned char**, bool, long*)

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-5890 Segmentation fault in ScannerContext::Stream::GetBytesInternal(long, unsigned char**, bool, long*)

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-4223 Avro scanner can crash when HDFS seek fails

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Activity

            People

              Unassigned Unassigned
              lv Lars Volker
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: