Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13098

RBF: Datanodes interacting with Routers

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Datanodes talk to particular Namenodes. We could use the Router infrastructure for the Datanodes to register/heartbeating into them and the Routers would forward this to particular Namenodes. This would make the assignment of Datanodes to subclusters potentially more dynamic.

      The implementation would potentially include:

      • Router to implement part of DatanodeProtocol
      • Forwarding DN messages into Routers
      • Policies to assign datanodes to subclusters
      • Datanodes to make blockpool configuration dynamic

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              elgoiri Íñigo Goiri
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated: