Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-12601

Add a fully partitioned TPC-DS dataset for planner tests

    XMLWordPrintableJSON

Details

    • Test
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Impala 4.3.0
    • Impala 4.4.0
    • Infrastructure
    • None

    Description

      testdata/datasets/tpcds only have store_sales table fully-partitioned and leave other facts table unpartitioned. This is probably intended for faster data loading during test. However, this is not an accurate reflection of larger scale TPC-DS dataset where all facts tables are partitioned. Impala planner may change the detail of query plan if partition column exist.

      Today, Impala can load a small scale, fully-partitioned TPC-DS dataset in parquet format to minicluster in reasonable speed. We should consider adding such test db and change PlannerTests to test against that fully-partitioned db instead of current tpcds/tpcds_parquet test db.

      Attachments

        Issue Links

          Activity

            People

              rizaon Riza Suminto
              rizaon Riza Suminto
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: