Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-9422

Improve join builder profiles

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • Impala 4.0.0
    • Backend

    Description

      We should clean up/improve the join builder profiles for the separate build.

      First, for the separate build, we should ensure that all time spent in the builder is counted against the builder. E.g. calls into public methods like BeginSpilledProbe(). These should be counted as idle time for the actual join implementation, so that we can see that the time is spent in the (serial) builder instead of the (parallel) probe.

      We might need to fix things like Send() being called by RepartitionBuildInput, resulting in double counting.

      Second, we should revisit the assortment of timers - BuildRowsPartitionTime, HashTablesBuildTime, RepartitionTime. Maybe it makes sense to make them child counters of total time to make the relationship clearer.

      Attachments

        Activity

          People

            bikramjeet.vig Bikramjeet Vig
            tarmstrong Tim Armstrong
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: