Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-7947

DeleteAzureDataLakeStorage Processor cannot delete non empty folder

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.15.0
    • Extensions
    • None

    Description

      The current implementation of DeleteAzureDataLakeStorage version 1.11.4.3.5.1.19-1 cannot delete non empty folder if you specify a folder name in "File name" field and leave empty "Directory name" field.

      The error message is 
      DeleteAzureDataLakeStorage[id=50e969ee-0175-1000-0000-000031e844c3] Failed to delete the specified file from Azure Data Lake Storage: com.azure.storage.file.datalake.models.DataLakeStorageException: Status code 409, "{"error":{"code":"DirectoryNotEmpty","message":"The recursive query parameter value must be true to delete a non-empty directory.\nRequestId:525ebddf-c01f-00cf-19a8-abcb94000000\nTime:2020-10-26T15:01:35.0517746Z"}}

       

      The azcopy command has extra flag "-recursive"  to delete non-empty folders:

      https://docs.microsoft.com/en-us/azure/storage/common/storage-ref-azcopy-remove

       

      Attachments

        Issue Links

          Activity

            People

              Lehel44 Lehel Boér
              stanislav.antufeev@gmail.com Stan Antyufeev
              Votes:
              3 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h
                  1h