Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3639

expr-test fails on asan on cdh5-2.6.0_5.8.0

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • Impala 2.6.0
    • Impala 2.6.0
    • Backend
    • Only reproduced on Jenkins boxes, non-deterministic but frequent.

    Description

      This has been failing ~50% of the time on the release branch (not trunk). The jobs don't seem to be capturing the asan dump, but manually running the binary on the build machine produced the asan output (see dump, attached). That dump is desymbolized in asan-dump-desymbolized.out:

      ==28516==ERROR: AddressSanitizer: heap-use-after-free on address 0x631000488818 at pc 0x000000f1b1ab bp 0x7ffffffc7470 sp 0x7ffffffc6c20
      READ of size 65355 at 0x631000488818 thread T0
      ==28516==WARNING: invalid path to external symbolizer!
      ==28516==WARNING: Failed to use and restart external symbolizer!
          #0 0xf1b1aa in memcpy _asan_rtl_:0
          #1 0x1d3ee1f in _ZNSs12_S_constructIPKcEEPcT_S3_RKSaIcESt20forward_iterator_tag ??:0:0
          #2 0x7ffff683565b in
          #3 0x102bd61 in _ZN6impala8ExprTest15TestStringValueERKSsS2_ /data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/be/src/exprs/expr-test.cc:314:12
          #4 0xfbb28a in _ZN6impala29ExprTest_StringFunctions_Test8TestBodyEv /data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/be/src/exprs/expr-test.cc:2137:3
          #5 0x2c51852 in _ZN7testing8internal35HandleExceptionsInMethodIfSupportedINS_4TestEvEET0_PT_MS4_FS3_vEPKc ??:0:0
          #6 0x2c491a9 in _ZN7testing4Test3RunEv ??:0:0
          #7 0x2c492f7 in _ZN7testing8TestInfo3RunEv ??:0:0
          #8 0x2c493d4 in _ZN7testing8TestCase3RunEv ??:0:0
          #9 0x2c4a657 in _ZN7testing8internal12UnitTestImpl11RunAllTestsEv ??:0:0
          #10 0x2c4a932 in _ZN7testing8UnitTest3RunEv ??:0:0
          #11 0x1024966 in main /data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/be/src/exprs/expr-test.cc:5893:10
          #12 0x3b7b41ecdc in
          #13 0xec1738 in _start ??:0:0
      
      0x631000488818 is located 24 bytes inside of 65380-byte region [0x631000488800,0x631000498764)
      freed by thread T0 here:
          #0 0xf98a90 in _ZdlPv _asan_rtl_:0
          #1 0x10509ed in _ZN6impala8ExprTest8GetValueERKSsRKNS_10ColumnTypeEPPvb /data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/be/src/exprs/expr-test.cc:250:3
          #2 0x102bcf8 in _ZN6impala8ExprTest15TestStringValueERKSsS2_ /data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/be/src/exprs/expr-test.cc:313:5
          #3 0xfbb28a in _ZN6impala29ExprTest_StringFunctions_Test8TestBodyEv /data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/be/src/exprs/expr-test.cc:2137:3
          #4 0x2c51852 in _ZN7testing8internal35HandleExceptionsInMethodIfSupportedINS_4TestEvEET0_PT_MS4_FS3_vEPKc ??:0:0
      
      previously allocated by thread T0 here:
          #0 0xf98490 in _Znwm _asan_rtl_:0
          #1 0x7ffff6833c48 in ?? ??:0
          #2 0x2cb3287 in _fini ??:0:0
      

      Related jobs:

      http://sandbox.jenkins.cloudera.com/view/Impala/view/Evergreen-cdh5-2.6.0_5.8.x/job/impala-cdh5-2.6.0_5.8.0-core-asan_0/9/

      http://sandbox.jenkins.cloudera.com/view/Impala/view/Evergreen-cdh5-2.6.0_5.8.x/job/impala-cdh5-2.6.0_5.8.0-core-asan_0/7/

      Attachments

        1. asan-dump-desymbolized.out
          4 kB
          Matthew Jacobs
        2. dump
          5 kB
          Thomas Tauber-Marshall

        Activity

          People

            twmarshall Thomas Tauber-Marshall
            twmarshall Thomas Tauber-Marshall
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: