Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-12783

Kafka Producer Processors do not route in failure queue on timeout

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.23.2
    • None
    • Core Framework
    • None

    Description

      Hi,

      the Kafka producer processors do not route the FlowFiles on a timeout e.g. into the failure connection. They are yielded in the incomming connection. 

      You can see the behaviour here e.g.:
      https://stackoverflow.com/questions/71460008/apache-nifi-publishkafka-timeout-exception

      I think this is a design flaw. I have a use case where messages should be dropped after a specific configurable time. If the messages are yielded in the incomming queue they are always published when the kafka broker are available again. I know I can set the expiration time in secs or mins in the incomming queue but it is not dynamically configurable because no attributes are allowed. 

      Best

      Denis

      Attachments

        Activity

          People

            Unassigned Unassigned
            djakupovic Denis Jakupovic
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated: