Details
-
Bug
-
Status: Open
-
Minor
-
Resolution: Unresolved
-
1.3.0, 1.4.0, 1.5.0, 1.6.0, 1.7.0, 1.8.0, 1.7.1, 1.9.0, 1.10.0, 1.9.1, 1.9.2, 1.11.0, 1.11.1, 1.11.2, 1.11.4
-
None
Description
NIFI-3962 introduced two hard-coded magic numbers into KafkaConsumers. :
- maxRecords is capped at 1000, regardless of the property setting
- the poll timeout is fixed at 10ms
Under high throughput & high latency conditions, this leads to too small small files.
Attachments
Issue Links
- is related to
-
NIFI-3962 Update ConsumeKafkaRecord_0_10 to better batch together messages into fewer flowfiles
-
- Resolved
-
- links to
