Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-8197

Validate Parquet files written by Impala using Parquet-mr

    XMLWordPrintableJSON

Details

    • Test
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Infrastructure
    • ghx-label-5

    Description

      Currently most of the insert tests write with Impala and also read back the values with Impala to check they were written correctly. Some bugs can be missed this way if both Impala's reader and writer logic are consistently wrong. Reading the values back with a Parquet-mr based tool like parquet-tool or Hive would help to catch such bugs.

      Attachments

        Activity

          People

            Unassigned Unassigned
            csringhofer Csaba Ringhofer
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: