Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-6677

ListHDFS can clear state and re-list everything on Primary Node change if property was modified before Processor started

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.10.0
    • Extensions
    • None

    Description

      If the "Directory" or "File Filter" property is changed in ListHDFS, and then the Processor is started, a change in the Primary Node can result in resetting the Processor state.

      To replicate, create a ListHDFS Processor in a cluster. Configure to point to some directory and start the processor running on Primary Node. After the listing has completed, disconnect the Primary Node from the cluster to trigger the Primary Node to change. At this point, the Processor will reset its state and re-list everything.

      Note that once NiFi has been restarted, this behavior will no longer exist until the Processor's Directory or "File Filter" property is changed again. It also will not happen again if the new Primary Node has already reset the state as a result of the property change.

      Attachments

        Issue Links

          Activity

            People

              markap14 Mark Payne
              markap14 Mark Payne
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 0.5h
                  0.5h