Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-16791

Add getEnclosingRoot() API to filesystem interface and implementations

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.3.6
    • 3.4.0, 3.3.9
    • fs

    Description

      At LinkedIn we run many HDFS volumes that are federated by either ViewFilesystem or Router Based Federation. As our number of hdfs volumes grows, we have a growing need to migrate data seemlessly across volumes.

      Many frameworks have a notion of staging or temp directories, but those directories often live in random locations. We want an API getEnclosingRoot, which provides the root path a file or dataset. 

      In ViewFilesystem / Router Based Federation, the enclosingRoot will be the mount point.

      We will also take into account other restrictions for renames like encryptions zones.

      If there are several paths (a mount point and an encryption zone), we will return the longer path

      Attachments

        Activity

          People

            mccormickt12 Tom McCormick
            mccormickt12 Tom McCormick
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: