Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-5583

Make Change Data Capture (CDC) processor for MySQL refer to GTID

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.7.1
    • 1.13.0, 1.12.1
    • Extensions
    • None

    Description

      When connecting to a MySQL cluster consisting of multiple hosts, existing CDC processor can not automatically switch to other host when the connected host goes down.
      The reason is that file names and positions of binary log may be different for each host in the same cluster.
      In such a case it is impossible to continue reading files from the same position.

      In order to continue reading in such cases, a processor referring to the GTID (Global Transaction ID) is necessary.
      GTID is ID that uniquely identifies a transaction, and it is recorded in binary log of MySQL.

      Attachments

        Activity

          People

            yoshiata Yoshiaki Takahashi
            yoshiata Yoshiaki Takahashi
            Votes:
            1 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 3h 10m
                3h 10m