Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-5920

Processor to tag an existing S3 object

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.9.0
    • 1.9.0
    • Extensions
    • None

    Description

      A common use case for data aggregation projects is to use AWS S3 as data staging zone. Files are uploaded to S3 buckets from various sources, and NiFi is used to fetch the S3 objects and perform additional processing.

      AWS S3 lifecycle management policies allow transitioning S3 objects from standard storage to glacier storage for cost savings in long-term storage. A lifecycle management rule can be set to transition an object that has a particular tag. 

      Currently, the only way to tag an S3 object via NiFi is to through the PutS3Object processor. For the above use case, where an S3 object was uploaded by a second- or third-party, it would be very helpful to have a TagS3Processor that can tag an existing S3 object, so that the s3 lifecycle management policy can be triggered after NiFi has processed the S3 object.

       

      Attachments

        Issue Links

          Activity

            People

              sgoodman Stephen Goodman
              sgoodman Stephen Goodman
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 40m
                  1h 40m