Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-6821

Push down limits into Kudu

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • Backend
    • ghx-label-9

    Description

      The progress made in KUDU-16 introduced a way to impose limits on Kudu scanners, potentially reducing the number of RPCs sent per scan, CPU used for scanner evaluation on the tablet server, etc. It would be nice if Impala could make use of this new behavior.

      I put up an admittedly clunky patch that implements limits on a per-token basis. I'm no Impala expert, so there may be an API missing in Kudu that would make Impala's life easier in implementing this. Maybe it's as easy as adjusting the limit after re-hydrating the token into a scanner.

      Attachments

        Activity

          People

            twmarshall Thomas Tauber-Marshall
            awong Andrew Wong
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: