Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-8333

Issues with invokehttp/SSL Service after "Terminate Task" (e.g. due to long running transactions) and misleading error-message

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.12.1, 1.13.2
    • None
    • None

    Description

      There seems to be an issue with InvokeHTTP 1.12.1 or StandardRestrictedSSLContextService 1.12.1 or both.

      We observed a lot of "SSLHandshakeException"s (...) "unable to find valid certification path to requested target" in some situations.

      At first we had a very close look into our keystore which is used in our StandardRestrictedSSLContextService and made sure everything was fine. In the end we figured out we had used an older, no longer valid oAuth token and the webservice simlpy had rejected our request.

      Then we got the "SSLHandshakeException"s out of the blue in situations of very intense testing where we started and stopped tests runs over and over again. The oAuth token was still valid and other processors of the same kind and even exact copies of the now failing processor worked fine

      We discovered the following steps to reproduce the issue in our environment (Nifi 1.12.1 & 1.13.2):

      • create input data for the InvokeHTTP
      • make sure the contacted endpoint does not respond but have a high timeout setting in InvokeHttp to be able to terminate the processor
      • start InvokeHTTP
      • let it run for some time
      • stop the InvokeHTTP-processor
      • "Terminate" should be available in the context menu if there are still open requests waiting for an answer (or timeout)
      • terminate it
      • wait until all tasks are finally stopped
      • start the InvokeHTTP again

      "SSLHandshakeException" Errors should be visible now in the nifi-app.log on all machines where the invokehttp-processor had to terminate some tasks. They'll
      stay until you restart those nifi instances

      Our configuration

      • Cluster: 3 server, one nifi instance each
      • nifi in "http-mode" on port 8081 (nifi-properties)

      more details in the screenshots

       

      Attachments

        1. 1_config_invokeHttp_settings.png
          93 kB
          Andreas Klingenstein
        2. 2_config_invokeHttp_scheduling.png
          23 kB
          Andreas Klingenstein
        3. 3_config_invokeHttp_config_1.png
          64 kB
          Andreas Klingenstein
        4. 4_config_invokeHttp_config_2.png
          52 kB
          Andreas Klingenstein
        5. 5_config_invokeHttp_config_3.png
          45 kB
          Andreas Klingenstein
        6. 6_sslcontextservice_settings.png
          39 kB
          Andreas Klingenstein
        7. 7_sslcontextservice_properties.png
          48 kB
          Andreas Klingenstein
        8. 8_config_invokeHttp_Terminate_Task.png
          65 kB
          Andreas Klingenstein
        9. SSLHandshakeException.txt
          49 kB
          Andreas Klingenstein

        Activity

          People

            Unassigned Unassigned
            aklingens Andreas Klingenstein
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: