Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-3693

Improve Nifi Cluster Behavior In Down Scenarios

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      Improve Nifi cluster behavior by allowing nodes to receive flow changes when not all cluster nodes are online, so long as the node(s?) receiving the changes are registered/active with Zookeeper. Then when require down nodes to update to latest flow version with cluster before cluster re-join is completed. This would probably require external/non-embedded zookeeper to insure valid quorum. For any flow files already queued up on a node, process them on the old flow prior to changing to the new flow and make sure flow is current before starting any processors consuming data from outside systems.
      This was born out of a situation where one of our pre-prod cluster nodes has been down for nearly a week, and the cluster being read-only until all nodes are back online has prevented any further development work from being done.

      Attachments

        Activity

          People

            Unassigned Unassigned
            techathead Tommy Young
            Votes:
            1 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: