Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-31951

Mix schema record source creates corrupt record

    XMLWordPrintableJSON

Details

    Description

      This seems to be an unexpected side effect with how AvroDeserializationSchema class was written.

      Sometimes we do not have control over what record comes through a Kafka Topic.

      In current implementation, if AvroDeserializationSchema encountered a record byte array that does not conform to the specified Schema / SpecificRecord type, it will cause future record to be deserialized incorrectly.

      Origin of the issue is with how

      AvroDeserializationSchema.deserialize

      handles exception, and how

      AvroDeserializationSchema.checkAvroInitialized

      handles initialization of Decoder object

      Attachments

        Issue Links

          Activity

            People

              aeolus811tw Kevin Tseng
              aeolus811tw Kevin Tseng
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: