Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
1.23.2
-
None
-
None
Description
Hi,
the Kafka producer processors do not route the FlowFiles on a timeout e.g. into the failure connection. They are yielded in the incomming connection.
You can see the behaviour here e.g.:
https://stackoverflow.com/questions/71460008/apache-nifi-publishkafka-timeout-exception
I think this is a design flaw. I have a use case where messages should be dropped after a specific configurable time. If the messages are yielded in the incomming queue they are always published when the kafka broker are available again. I know I can set the expiration time in secs or mins in the incomming queue but it is not dynamically configurable because no attributes are allowed.
Best
Denis