Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-686

Delta apply optimizations

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Trivial
    • Resolution: Fixed
    • M4.5
    • 1.9.0
    • perf, tablet
    • None

    Description

      We currently iterate on each delta file several times, one for deletes and then one for each one of the columns.

      It seems that, when selecting all the columns it would be more efficient to apply the deltas to all columns at the same time. This might or might not be advantageous depending on the number of columns projected. Todd also suggest that whether this is an advantage also depends on whether there are predicates being pushed down.

      We could likely also merge the updates and deletes into a single iteration or at least avoid applying the mutations if the row will end up delete (right now we still apply the updates even when we find that the row will be deleted).

      Attachments

        Issue Links

          Activity

            People

              adar Adar Dembo
              dralves David Alves
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: