Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-27165

Upgrade Apache ORC to 1.5.5

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.4.1, 3.0.0
    • 2.4.1, 3.0.0
    • Build
    • None

    Description

      This issue aims to update Apache ORC dependency to fix SPARK-27107 .

      [ORC-452] Support converting MAP column from JSON to ORC
Improvement
[ORC-447] Change the docker scripts to keep a persistent m2 cache
[ORC-463] Add `version` command
[ORC-475] ORC reader should lazily get filesystem
[ORC-476] Make SearchAgument kryo buffer size configurable

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. SPARK-27107 Spark SQL Job failing because of Kryo buffer overflow with ORC

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #24096

          Web Link GitHub Pull Request #24097

          Activity

            People

              dongjoon Dongjoon Hyun
              dongjoon Dongjoon Hyun
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: