Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5704

Parallelise read I/O for spilling operators where it is currently sequential

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • Impala 2.10.0
    • None
    • Backend

    Description

      After IMPALA-3200 goes in, we can make improvements to the performance of spilling operators by exploiting the new async pin behaviour of IMPALA-5169. There are several known cases where read I/O is not effectively overlapped with compute, and multiple disks are not used effectively by doing multiple I/Os concurrently

      Attachments

        Activity

          People

            Unassigned Unassigned
            tarmstrong Tim Armstrong
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: