Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3430

Runtime filter : Extend runtime filter to support Min/Max values for HDFS scans

    XMLWordPrintableJSON

Details

    Description

      Annotating Runtime filters with Min/Max values can help with

      • Inequality joins
      • Pushing more efficient filters to the scan
      • Used to skip reading Parquet blocks reducing IO.

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-5509 Runtime filter : Extend runtime filter to support Dictionary values

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-10325 Parquet scan should use min/max statistics to skip pages based on equi-join predicate

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. IMPALA-5843 Use page index in Parquet files to skip pages

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. IMPALA-4252 Add RuntimeFilters for min/max at KuduScanNode

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. IMPALA-10869 Extend min/max filter for inequality subquery for other use cases

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. IMPALA-4989 Improve filtering based on parquet::Statistics

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. IMPALA-5789 Prune all partitions if an always-false runtime filter is received

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              sql_forever Qifan Chen
              mmokhtar Mostafa Mokhtar
              Votes:
              3 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: