Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-6940

CTAS partition parquet file with non existant columns

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.14.0
    • None
    • Metadata, Storage - Parquet
    • None

    Description

      Drill allows to create parquet files with partition and metadata that allow potential pruning.

      Currently the "PARTITION BY" can only apply on present-column.

      It will be useful to have the possibility to allow PARTITION BY on "non-present data" or "computed data"

      Examples :

      • I have a,b and c, and I want to put only "b" and "c" in the parquet but partition on "a"
      • I have a,b and c, and I want to put "a", "b" and "c" in the parquet and partition NOT on a but on myfct(a)

       

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            benj641 benj
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: