Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-7934

FetchS3Object processor should support range requesting

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Minor
    • Resolution: Duplicate
    • None
    • None
    • Extensions
    • Patch

    Description

      The existing FetchS3Object processor currently retrieves the entire content of the object from S3.  This can be problematic for flows running on constrained resources where limited storage space is available on the host.  To mitigate, and provide for more opportunity for parallel flowfile processing, it would be helpful if the FetchS3Object processor exposed the ability to range request the content.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              lucasmoten Lucas Moten
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 24h
                  24h
                  Remaining:
                  Time Spent - 40m Remaining Estimate - 23h 20m
                  23h 20m
                  Logged:
                  Time Spent - 40m Remaining Estimate - 23h 20m
                  40m