Uploaded image for project: 'ORC'
  1. ORC
  2. ORC-965

Got "Overflow detected" at spark-orc with zstd

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 1.6.9, 1.6.10
    • 1.7.0, 1.6.11
    • Java
    • None

    Description

       Write to the orc format data and throw a Overflow detected exception。

      sql: insert overwrite table nlp_dev.bank_txt_classified_v2 partition(file_no, class_label) SELECT * from nlp_dev.tdl_table_qiusuo_20210821

      orc: 1.6.10

      aircompression: 0.20 | 0.19

      spark 3.0.4

      Attachments

        Issue Links

          Activity

            People

              dongjoon Dongjoon Hyun
              melin melin
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: