Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-1870

Handle INT96 more gracefully in parquet-avro

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Won't Fix
    • 1.11.0
    • None
    • parquet-avro
    • None

    Description

      The parquet-avro library does not support INT96 columns (PARQUET-323), and any attempt to process a file containing such a column results in:

      throw new IllegalArgumentException("INT96 not implemented and is deprecated");

      INT96 is still used in many legacy datasets, and so it would be useful to be able to process Parquet files containing these records, even if the INT96 values themselves aren't rendered.

      The same functionality has already been re-added into parquet-pig (PARQUET-1133).

      Attachments

        Activity

          People

            Unassigned Unassigned
            benwatson528 Ben Watson
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: