Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-11670

Encrypted Content Repository is very slow when FlowFiles have a non-zero Content Claim Offset

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0-M1, 1.23.0
    • Core Framework
    • None

    Description

      To replicate, create a flow with GenerateFlowFile -> MergeContent

      Configure GenerateFlowFile to generate 25 KB FlowFiles with a batch size of 1,000. It's important in order to replicate, that batch size be used.

      Configure MergeContent to merge bins of 1,000 FlowFiles.

      Merging the files when using unencrypted/default content repository takes milliseconds. Using Encrypted Repo it takes nearly a minute.

      Attachments

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. NIFI-11971 FlowFile content is corrupted across the whole NiFi instance throughout ProcessSession::write with omitting writing any byte to OutputStream

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          fixes

          Bug - A problem which impairs or prevents the functions of the product. NIFI-10235 Provenance replay fails when repository encryption is enabled

          • Major - Major loss of function.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. NIFI-11679 Refactor EncryptedRepoContentAccessIT Configuration

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Web Link GitHub Pull Request #7363

          Activity

            People

              markap14 Mark Payne
              markap14 Mark Payne
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m