Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-4906

Add GetHdfsFileInfo Processor

    XMLWordPrintableJSON

Details

    Description

      Add GetHdfsFileInfo Processor to be able to get stats from a file system.

      This processor should support recursive scan, getting information of directories and files.

      File-level info required: name, path, length, modified timestamp, last access timestamp, owner, group, permissions.

      Directory-level info required: name, path, sum of lengths of files under a dir, count of files under a dir, modified timestamp, last access timestamp, owner, group, permissions.

       

      The result returned:

      • in single flow file (in content - a json line per file/dir info);
      • flow file per each file/dir info (in content as json obj or in set of attributes by the choice).

      Attachments

        1. gethdfsfileinfo.patch
          93 kB
          Ed Berezitsky
        2. NiFi-GetHDFSFileInfo.pdf
          131 kB
          Ed Berezitsky

        Issue Links

          Activity

            People

              bdesert Ed Berezitsky
              bdesert Ed Berezitsky
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: