Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-11839

impala fails to read iceberg table stored as avro which has decimal(15,2) datatype created by hive

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • ghx-label-1

    Description

      Create table using Hive
      CREATE EXTERNAL TABLE decimal_table_txt (decimal_col decimal(15,2)) ROW FORMAT DELIMITED FIELDS TERMINATED BY '|' stored as TEXTFILE LOCATION 's3a://dwx-testdata/tmp/tpch/data/customer';CREATE TABLE decimal_table STORED BY iceberg STORED AS avro AS SELECT * FROM decimal_table_txt;
      When trying to read iceberg table (stored as avro) using impala with decimal(15,2) as datatype it fails to return the rows.

      select * from decimal_table;

      Output:

      Query 88420c9d3ee0e2f1:4ef29b2a00000000 100% Complete (2 out of 2)
      Avro enum, array, map, union, and fixed types are not supported. Got type: fixed
      Avro enum, array, map, union, and fixed types are not supported. Got type: fixed
      Query 88420c9d3ee0e2f1:4ef29b2a00000000 100% Complete (2 out of 2)
      Avro enum, array, map, union, and fixed types are not supported. Got type: fixed
      Avro enum, array, map, union, and fixed types are not supported. Got type: fixed
      Query 88420c9d3ee0e2f1:4ef29b2a00000000 100% Complete (2 out of 2)
      Avro enum, array, map, union, and fixed types are not supported. Got type: fixed
      Avro enum, array, map, union, and fixed types are not supported. Got type: fixed 
      Done. 0 results. 88420c9d3ee0e2f1:4ef29b2a00000000

      Attachments

        Activity

          People

            noemi Noemi Pap-Takacs
            riddhi.jain Riddhi jain
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: