Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-8656 Support for eagerly fetching and spooling all query result rows
  3. IMPALA-8779

Add RowBatchQueue interface with an implementation backed by a std::queue

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • Backend
    • None
    • ghx-label-8

    Description

      Add a RowBatchQueue interface with an implementation backed by a std::queue. Introducing a generic queue that can buffer RowBatch-es will help with the implementation of BufferedPlanRootSink. Rather than tie the BufferedPlanRootSink to a specific method of queuing row batches, we can use an interface. In future patches, a RowBatchQueue backed by a BufferedTupleStream can easily be switched out in BufferedPlanRootSink.

      We should consider re-factoring the existing RowBatchQueue to use the new interface. The KRPC receiver does some buffering of RowBatch-es as well which might benefit from the new RowBatchQueue interface, and some more KRPC buffering might be added inĀ IMPALA-6692.

      Attachments

        Activity

          People

            stakiar Sahil Takiar
            stakiar Sahil Takiar
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: