Uploaded image for project: 'ORC'
  1. ORC
  2. ORC-315

More robust on reading random corrupt files

    XMLWordPrintableJSON

Details

    • Task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • C++
    • None

    Description

      We're going to support ORC in Impala by integrating the c++ lib (IMPALA-5717). Currently, we cannot move forward since one of the tests keep failing. This test corrupts a normal ORC file randomly and sees if the system crash on reading it. Unfortunately, the c++ lib seems not quite robust right now and crash easily.

      I've filed some JIRAs about this: ORC-311, ORC-312, ORC-313, ORC-314. I think we should introduce the random corrupt test for ORC lib as well. Hopes we can accelerate progress and make IMPALA-5717 done.

      Thanks!

      Attachments

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-6772 Enable test_scanners_fuzz for ORC format

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. ORC-311 C++ Reader crash for corrupt StripeFooter

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. ORC-312 C++ Reader crash for corrupt memory

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. ORC-313 Missing checks on SubType count of LIST, MAP and UNION types

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. ORC-314 C++ Reader crash for out of range scale in parsing decimals

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. ORC-317 C++ reader crash on reading corrupt types

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. ORC-319 C++ reader crash after Lz4DecompressionStream thrown a ParseError

          • Major - Major loss of function.
          • Closed

          Activity

            People

              stigahuang Quanlong Huang
              stigahuang Quanlong Huang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: