Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5049

Switch Parquet timestamp format to INT64

    XMLWordPrintableJSON

Details

    • Epic
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • Impala 2.9.0
    • None
    • Backend
    • Switch Parquet timestamp format to INT64
    • ghx-label-4

    Description

      We currently use INT96 to store Timestamp values in Parquet files which will be deprecated in PARQUET-323.

      We need to add read and write support for INT64-based logical types (TIMESTAMP_MILLIS, TIMESTAMP_MICROS) to our Parquet scanner and writer.

      Attachments

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-8824 Support Parquet time related logical types

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. IMPALA-9408 Execute the TIMESTAMP roadmap

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              lv Lars Volker
              Votes:
              3 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated: