Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-9856

Enable result spooling by default

    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • Impala 4.0.0
    • Backend
    • None
    • ghx-label-10

    Description

      Result spooling has been relatively stable since it was introduced, and it has several benefits described in IMPALA-8656. It would be good to enable it by default.

      I looked into doing this a while ago, and there are a bunch of tests that rely on the "fetch one row batch at a time" behavior. Those tests fail when result spooling is enabled.

      The remaining linked tasks in IMPALA-8656 should be completed as well before enabling result spooling by default.

      Attachments

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-12932 SPOOL_QUERY_OPTION Default Value Mismatch Between Code and Docs

          • Major - Major loss of function.
          • Open
          relates to

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-10259 Hit DCHECK in TestImpalaShell.test_completed_query_errors_2

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-10371 test_java_udfs crash impalad if result spooling is enabled

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-10337 DCHECK hit at SpillableRowBatchQueue when row size exceed max reservation

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. IMPALA-8656 Support for eagerly fetching and spooling all query result rows

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              rizaon Riza Suminto
              stakiar Sahil Takiar
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: