Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-35209

Add a DeserializationSchema decorator that counts deserialize errors

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • API / Core
    • None

    Description

      I would like to propose a PR that implements a decorator for `DeserializationSchema`.

      The decorator decorates an `DeserializationSchema` object. The purpose of this decorator is to catch any deserialization errors that could occur when deserializing messages. The decorator has a flag to decide to fail or not in this case. If it makes the error silent, then it would count them in a `flink.metrics.Counter` so the user can monitor the silent errors. This PR is ready to be created.

      This decorator could be improved by having a sink that would be used to sink all the messages causing deserialization errors.

      Attachments

        Activity

          People

            Unassigned Unassigned
            npfp Nicolas Perrin
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: