Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8794

Projects should be handled by an IOPushDownRule before applying AggregateProjectMergeRule

Details

    • Improvement
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.18.0
    • dsl-sql
    • None

    Description

      It is more efficient to push-down projected fields at an IO level (vs merging with an Aggregate), when supported.

      When running queries like:

      select SUM(score) as total_score from <TABLE> group by name

      Projects get merged with an aggregate, as a result Calc (after an IOSourceRel) projects all fields and BeamIOPushDown rule does know what fields can be dropped, thus not dropping any.

      Attachments

        Issue Links

          Activity

            People

              kirillkozlov Kirill Kozlov
              kirillkozlov Kirill Kozlov
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 3h 20m
                  3h 20m