Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-12245

TestWebPage::test_query_progress is flaky

    XMLWordPrintableJSON

Details

    • ghx-label-10

    Description

      The test can fail with error like following:

      tests/webserver/test_web_pages.py:923: in test_query_progress
          query, self.QUERIES_URL, expected_state=self.client.QUERY_STATES["RUNNING"])
      tests/webserver/test_web_pages.py:517: in __run_query_and_get_debug_page
          query_handle = self.client.execute_async(query)
      tests/common/impala_connection.py:219: in execute_async
          beeswax_handle = self.__beeswax_client.execute_query_async(sql_stmt, user=user)
      tests/beeswax/impala_beeswax.py:361: in execute_query_async
          handle = self.__do_rpc(lambda: self.imp_service.query(query,))
      tests/beeswax/impala_beeswax.py:524: in __do_rpc
          raise ImpalaBeeswaxException(self.__build_error_message(b), b)
      E   ImpalaBeeswaxException: ImpalaBeeswaxException:
      E    INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
      E    MESSAGE: Invalid session id: 28479f2cbfe0e3cd:bacd651a1bdf53ac

      This is reproducible by through this commands:

      start-impala-cluster.py --log_dir="${IMPALA_EE_TEST_LOGS_DIR}"
      impala-py.test tests/webserver/test_web_pages.py

      Looking at the log, I see that the session is terminated while the sleep query is still running

      I0626 18:06:41.442545 1887891 impala-server.cc:1372] e44683226b8bf78a:d2f55bb000000000] Registered query query_id=e44683226b8bf78a:d2f55bb000000000 session_id=28479f2cbfe0e3cd:bacd651a1bdf53ac
      I0626 18:06:41.442708 1887891 Frontend.java:1995] e44683226b8bf78a:d2f55bb000000000] Analyzing query: select sleep(10000) db: default
      ...
      I0626 18:06:41.445427 1888532 status.cc:129] Cancelled from Impala's debug web interface by user: 'anonymous' at 127.0.0.1:36216
          @          0x101174f  impala::Status::Status()
          @          0x15d3ecd  impala::ImpalaHttpHandler::CancelQueryHandler()
          @          0x15c825f  _ZN5boost6detail8function26void_function_obj_invoker2IZN12_GLOBAL__N_112MakeCallbackIN6impala17ImpalaHttpHandlerEMS6_FvRKN4kudu19WebCallbackRegistry10WebRequestEPN9rapidjson15GenericDocumentINSC_4UTF8IcEENSC_19MemoryPoolAllocatorINSC_12CrtAllocatorEEESH_EEEEENS_8functionIFvSB_SK_EEEPT_RKT0_EUlRKSQ_PSS_E_vSB_SK_E6invokeERNS1_15function_bufferESB_SK_
          @          0x1958a0b  impala::Webserver::RenderUrlWithTemplate()
          @          0x195db65  impala::Webserver::BeginRequestCallback()
          @          0x195e494  impala::Webserver::BeginRequestCallbackStatic()
          @          0x196e1c9  handle_request
          @          0x1970438  process_new_connection
          @          0x1970afc  worker_thread
          @     0x7feeaca85609  start_thread
          @     0x7feeaaaa7133  clone
      I0626 18:06:41.456089 1888532 impala-server.cc:1456] UnregisterQuery(): query_id=e44683226b8bf78a:d2f55bb000000000
      I0626 18:06:41.456102 1888532 coordinator.cc:743] ExecState: query id=e44683226b8bf78a:d2f55bb000000000 execution cancelled
      ...
      I0626 18:06:46.467233 1886939 impala-server.cc:1633] Invalid or unknown query handle: e44683226b8bf78a:d2f55bb000000000.
      I0626 18:06:46.467271 1886939 control-service.cc:179] ReportExecStatus(): Received report for unknown query ID (probably closed or cancelled): e44683226b8bf78a:d2f55bb000000000 remote host=127.0.0.1:40430

      There seems to be interference between test_display_src_socket_in_query_cause and test_query_progress.

      Attachments

        Activity

          People

            rizaon Riza Suminto
            rizaon Riza Suminto
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: