[KAFKA-8523] InsertField transformation fails when encountering tombstone event - ASF JIRA

Agile Board

Attach files

Attach Screenshot

Voters

Stop watching

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 1.0.3, 1.1.2, 2.0.2, 2.1.2, 2.2.2, 2.4.0, 2.3.1
Component/s: connect
Labels:
None

Description

When applying the InsertField transformation to a tombstone event, an exception is raised:

org.apache.kafka.connect.errors.DataException: Only Map objects supported in absence of schema for [field insertion], found: null
	at org.apache.kafka.connect.transforms.util.Requirements.requireMap(Requirements.java:38)
	at org.apache.kafka.connect.transforms.InsertField.applySchemaless(InsertField.java:138)
	at org.apache.kafka.connect.transforms.InsertField.apply(InsertField.java:131)
	at org.apache.kafka.connect.transforms.InsertFieldTest.tombstone(InsertFieldTest.java:128)

~~AFAICS, the transform can still be made working in in this case by simply building up a new value map from scratch.~~

Update as per the discussion in the comments: tombstones should be left as-is by this SMT, as any insertion would defeat their purpose of enabling log compaction.