Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-10586

Full support for distributed mode in dedicated MirrorMaker 2.0 clusters

    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Major
    • Resolution: Done
    • None
    • 3.5.0
    • mirrormaker

    Description

      KIP-382 introduced MirrorMaker 2.0. Because of scoping issues, the dedicated MirrorMaker 2.0 cluster does not utilize the Connect REST API. This means that with specific workloads, the dedicated MM2 cluster can become unable to react to dynamic topic and group filter changes.

      (This occurs when after a rebalance operation, the leader node has no MirrorSourceConnectorTasks. Because of this, the MirrorSourceConnector is stopped on the leader, meaning it cannot detect config changes by itself. Followers still running the connector can detect config changes, but they cannot query the leader for config updates.)

      Besides the REST support, config provider references should be evaluated lazily in connector configurations.

      Attachments

        Issue Links

          fixes

          Bug - A problem which impairs or prevents the functions of the product. KAFKA-9981 Running a dedicated mm2 cluster with more than one nodes,When the configuration is updated the task is not aware and will lose the update operation.

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. KAFKA-14898 [ MirrorMaker ] sync.topic.configs.enabled not working as expected

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. KAFKA-10582 Mirror Maker 2 not replicating new topics until restart

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. KAFKA-10857 Mirror Maker 2 - replication not working when deploying multiple instances

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. KAFKA-15372 MM2 rolling restart can drop configuration changes silently

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              ChrisEgerton Chris Egerton
              durban Daniel Urban
              Votes:
              5 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: