Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-7382

List File isn't stopped when migrated from Single node to Clustered NiFi setup

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.9.2
    • None
    • None
    • On windows, Linux. Not tried in mac

    Description

      NiFi was 1st deployed in single node (node06) and a flow was created like shown below 

      ListFile --> FetchFile --> UpdateAttribute --> PutHDFS -->..

      The flow works well in single node and was versioned using nifi registry. Once registered, NiFi was scaled Up with 2 more nodes (node04 & node05) to form a cluster of 3 nodes. The same version of the flow from the nifi registry was copied on both of the new nodes. 

      Issue:

      The primary is still the original node and the new nodes are acting like secondary. The new nodes however does not have the directory structure which the ListFile processor used to list the files, hence there is an exception state in the processor. 

      If I wish to change the scheduling state from all nodes to primary  nodes it is not allowing this operation. It is not allowing any modifications in this state of the processor.  The error is pops up says the processor is not stopped and is unable to fulfill the request. This is mis leading and has to be corrected with proper statements.  

      Attachments

        1. NiFi-ListFile-issue.JPG
          81 kB
          Ghanashyam
        2. NiFi-exceptionState-issue.JPG
          210 kB
          Ghanashyam
        3. NiFi-cluster-issue.JPG
          96 kB
          Ghanashyam

        Activity

          People

            Unassigned Unassigned
            ghanashyam Ghanashyam
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: