Details
Description
We have run into issues several times where corrupted records cause the Kafka consumer to throw an error code 2 exception (CRC checksum failure) in the fetch layer. Specifically, when using Kafka streams we run into KAFKA-6977 that throws an IllegalStateException and crashes the service. It would be great if the Kafka consumer could be extended with a setting similar to KIP-161, that would allow one to gracefully ignore corrupted records.
Attachments
Issue Links
- is related to
-
KAFKA-5682 Consumer should include partition in exceptions raised during record parsing/validation
- In Progress