Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-1928

Interpret Parquet INT96 type as FIXED[12] AVRO Schema

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.11.0
    • 1.12.0
    • parquet-avro
    • Patch

    Description

      Reading Parquet files in Apache Beam using ParquetIO uses `AvroParquetReader` causing it to throw `IllegalArgumentException("INT96 not implemented and is deprecated")`

      Customers have large datasets which can't be reprocessed again to convert into a supported type. An easier approach would be to convert into a byte array of 12 bytes, that can then be interpreted by the developer in any way they want to interpret it.

      Attachments

        Issue Links

          Activity

            People

              anantdamle Anant Damle
              anantdamle Anant Damle
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: