Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-7067

Querying parquet file with null value field error

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Blocker
    • Resolution: Unresolved
    • 1.15.0
    • Future
    • Storage - Parquet
    • None
    • Ubuntu 18.04.1 LTS 

      Apache Drill 1.15.0 

    Description

      When we try to join two parquet tables and one of them has null values on any field, the query doesn't run. It fails showing the following error: 

      Error: SYSTEM ERROR: IllegalStateException: Failure while reading vector. Expected vector class of org.apache.drill.exec.vector.NullableIntVector but was holding vector class org.apache.drill.exec.vector.NullableVarDecimalVector, field= [`id_hubbles` (VARDECIMAL(38, 4):OPTIONAL), children=([`$bits$` (UINT1:REQUIRED)], [`id_hubbles` (VARDECIMAL(38, 4):OPTIONAL), children=([`$offsets$` (UINT4:REQUIRED)])])]

      Fragment 2:0

      Please, refer to logs for more information.

      Error Id: 48f63255-c771-4809-8252-ef7a78fda31b on ################

      (java.lang.IllegalStateException) Failure while reading vector. Expected vector class of org.apache.drill.exec.vector.NullableIntVector but was holding vector class org.apache.drill.exec.vector.NullableVarDecimalVector, field= [`id_hubbles` (VARDECIMAL(38, 4):OPTIONAL), children=([`$bits$` (UINT1:REQUIRED)], [`id_hubbles` (VARDECIMAL(38, 4):OPTIONAL), children=([`$offsets$` (UINT4:REQUIRED)])])]
      org.apache.drill.exec.record.VectorContainer.getValueAccessorById():324
      org.apache.drill.exec.record.RecordBatchLoader.getValueAccessorById():251
      org.apache.drill.exec.physical.impl.unorderedreceiver.UnorderedReceiverBatch.getValueAccessorById():142
      org.apache.drill.exec.test.generated.PartitionerGen1732$OutgoingRecordBatch.doSetup():114
      org.apache.drill.exec.test.generated.PartitionerGen1732$OutgoingRecordBatch.initializeBatch():399
      org.apache.drill.exec.test.generated.PartitionerGen1732.flushOutgoingBatches():185
      org.apache.drill.exec.physical.impl.partitionsender.PartitionerDecorator$FlushBatchesHandlingClass.execute():285
      org.apache.drill.exec.physical.impl.partitionsender.PartitionerDecorator$PartitionerTask.run():340
      java.util.concurrent.ThreadPoolExecutor.runWorker():1149
      java.util.concurrent.ThreadPoolExecutor$Worker.run():624
      java.lang.Thread.run():748 (state=,code=0)

      Attachments

        Activity

          People

            Unassigned Unassigned
            jcachola Jardhel Cachola
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: