Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-2552 Runtime filter forwarding between operators
  3. IMPALA-2464

Heuristic for disabling Parquet scanner bitmap filters is broken.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Impala 2.2, Impala 2.3.0
    • Impala 2.5.0
    • Backend

    Description

      The Parquet scanner attempts to collect statistics about how many rows are filtered out using the bitmap filters. However, it incorrectly counts the number of filtered rows so that it thinks that every row is rejected by the filter, i.e. that the filter is awesome. This means the bitmap filters are never disabled.

      Fix this obvious bug and do some performance validation that the heuristic is good.

      Attachments

        Activity

          People

            henryr Henry Robinson
            tarmstrong Tim Armstrong
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: