Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-25955

Partitioned tables migrated to Iceberg aren't cached in LLAP

    XMLWordPrintableJSON

Details

    Description

      Files of migrated partitioned tables don't contain partition values, however Iceberg's read schema has them. The difference between this read schema and file schema is considered an unsupported schema evolution by LlapRecordReader so it bails out before starting to read.

      We should remove identity partition column names from the read the schema, if we find that it's a not an Iceberg-written (so is migrated) file.

      Attachments

        Issue Links

          Activity

            People

              szita Ádám Szita
              szita Ádám Szita
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m