Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-4283

GenerateTableFetch should allow you to specify an initial Max Value (clone of defunct NIFI-3335)

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.4.0
    • Extensions
    • None

    Description

      NIFI-2583 added the ability (via dynamic properties) to specify initial Max Values for columns, to enable the user to "pick up where they left off" if something happened with a flow, a NiFi instance, etc. where the state was stored but the processing did not complete successfully.

      This feature would also be helpful in GenerateTableFetch, which also supports max-value columns.

      Since NIFI-2881 adds incoming flow file support, it's more useful if Initial max values can be specified via flow file attributes. Because if a table name is dynamically passed via flow file attribute and Expression Language, user won't be able to configure dynamic processor attribute in advance for each possible table.

      Add dynamic properties ('initial.maxvalue.<max_value_column>' same as QueryDatabaseTable) to specify initial max values statically, and also use incoming flow file attributes named 'initial.maxvalue.<max_value_column>' if any.

      Attachments

        Activity

          People

            mattyb149 Matt Burgess
            mattyb149 Matt Burgess
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: