Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-6787

ORC+ACID assumes all missing buckets are in ACID structure

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • 0.13.0
    • 0.13.0
    • File Formats
    • None

    Description

      ORC+ACID creates ACID structure splits for all missing buckets in a table

      java.lang.RuntimeException: java.io.IOException: java.io.IOException: Vectorization and ACID tables are incompatible.
      at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getRecordReader(OrcInputFormat.java:996)
      	at org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:240)
      	... 15 more
      

      The tables are normal ORC tables and are not using ACID structure at all.

      @@ -539,7 +539,7 @@ public void run() {
               for(int b=0; b < context.numBuckets; ++b) {
                 if (!covered[b]) {
                   context.splits.add(new OrcSplit(dir, b, 0, new String[0], null,
      -                               false, false, deltas));
      +                               isOriginal, false, deltas));
                 }
               }
      

      seems to fix the issue. owen.omalley, please confirm if that is what I should be doing.

      Attachments

        1. HIVE-6787.patch
          5 kB
          Owen O'Malley

        Activity

          People

            omalley Owen O'Malley
            gopalv Gopal Vijayaraghavan
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: