Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12615

Router-based HDFS federation phase 2

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.2.0
    • None

    Description

      This umbrella JIRA tracks set of improvements over the Router-based HDFS federation (HDFS-10467).

      Attachments

        Issue Links

          depends upon

          New Feature - A new feature of the product, which has yet to be developed. HDFS-10467 Router-based HDFS federation

          • Major - Major loss of function.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-13655 RBF: Add missing ClientProtocol APIs to RBF

          • Major - Major loss of function.
          • Resolved
          relates to

          New Feature - A new feature of the product, which has yet to be developed. HDFS-13098 RBF: Datanodes interacting with Routers

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. HDFS-13575 RBF: Track Router state

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. HDFS-13532 RBF: Adding security

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HDFS-13553 RBF: Support global quota

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-13653 Make dfs.client.failover.random.order a per nameservice configuration

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-13891 HDFS RBF stabilization phase I

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-13123 RBF: Add a balancer tool to move data across subcluster

          • Major - Major loss of function.
          • Patch Available
          1.
          		 RBF: Add WebHDFS Sub-task Resolved Wei Yan  
          2.
          		 RBF: Improve State Store FS implementation Sub-task Resolved Íñigo Goiri  
          3.
          		 RBF: Test Router-based federation using HDFSContract Sub-task Resolved Íñigo Goiri  
          4.
          		 RBF: Set MountTableResolver as default file resolver Sub-task Resolved Íñigo Goiri  
          5.
          		 RBF: Control MountTableResolver cache size Sub-task Resolved Íñigo Goiri  
          6.
          		 RBF: Fix Javadoc parameter errors Sub-task Resolved Wei Yan  
          7.
          		 RBF: Add router admin commands usage in HDFS commands reference doc Sub-task Resolved Yiqun Lin  
          8.
          		 RBF: Complete logic for -readonly option of dfsrouteradmin add command Sub-task Resolved Íñigo Goiri  
          9.
          		 RBF: Document Router and State Store metrics Sub-task Resolved Yiqun Lin  
          10.
          		 RBF: Add ACL support for mount table Sub-task Resolved Yiqun Lin  
          11.
          		 RBF: Add more unit tests for router admin commands Sub-task Resolved Yiqun Lin  
          12.
          		 RBF: Mount table entries not properly updated in the local cache Sub-task Resolved Íñigo Goiri  
          13.
          		 RBF: Support erasure coding methods in RouterRpcServer Sub-task Resolved Íñigo Goiri  
          14.
          		 RBF: Fix spurious TestRouterRpc#testProxyGetStats Sub-task Resolved Íñigo Goiri  
          15.
          		 RBF: Inconsistent Router OPTS config in branch-2 and branch-3 Sub-task Resolved Wei Yan  
          16.
          		 RBF: Fix doc error setting up client Sub-task Resolved tartarus

          0%
          Original Estimate - 24h
          Remaining Estimate - 24h
          17.
          		 RBF: Use the ZooKeeper as the default State Store Sub-task Resolved Yiqun Lin  
          18.
          		 RBF: Manage unavailable clusters Sub-task Resolved Yiqun Lin  
          19.
          		 RBF: Improve the unit test TestRouterRPCClientRetries Sub-task Resolved Yiqun Lin  
          20.
          		 RBF: Fix Routers information shown in the web UI Sub-task Resolved Wei Yan  
          21.
          		 RBF: Fix the hdfs router page missing label icon issue Sub-task Resolved Baolong Mao  
          22.
          		 RBF: Optimize name service safe mode icon Sub-task Resolved liuhongtong  
          23.
          		 RBF: Mount path not available after ADD-REMOVE-ADD Sub-task Resolved Wei Yan  
          24.
          		 RBF: Fix router location cache issue Sub-task Resolved Wu Weiwei  
          25.
          		 RBF: Complete document of Router configuration Sub-task Resolved Yiqun Lin  
          26.
          		 RBF: Move Router to its own module Sub-task Resolved Wei Yan  
          27.
          		 RBF: Resolvers to support mount points across multiple subclusters Sub-task Resolved Íñigo Goiri  
          28.
          		 RBF: Router to manage requests across multiple subclusters Sub-task Resolved Íñigo Goiri  
          29.
          		 RBF: Implement available space based OrderResolver Sub-task Resolved Yiqun Lin  
          30.
          		 RBF: Throw the exception if mount table entry validated failed Sub-task Resolved Baolong Mao  
          31.
          		 RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns Sub-task Resolved Chao Sun  
          32.
          		 RBF: ConnectionPool should return first usable connection Sub-task Resolved Ekanth Sethuramalingam  
          33.
          		 RBF: Update some inaccurate document descriptions Sub-task Resolved Yiqun Lin  
          34.
          		 RBF: Improve error message returned from subcluster Sub-task Resolved Íñigo Goiri  
          35.
          		 RBF: MountTableResolver doesn't return the correct mount point of the given path Sub-task Resolved wangzhiyuan  
          36.
          		 RBF: TestConnectionManager#testCleanup() test case need correction Sub-task Resolved Dibyendu Karmakar  
          37.
          		 RBF : Fix compilation error in branch-2 (TestMultipleDestinationResolver) Sub-task Resolved Brahma Reddy Battula  
          38.
          		 RBF: TestRouterAdminCLI#testCreateInvalidEntry fails on Windows Sub-task Resolved Íñigo Goiri  
          39.
          		 RBF: Fix FindBugs in hadoop-hdfs-rbf Sub-task Resolved Ekanth Sethuramalingam  
          40.
          		 RBF: Improve the interfaces to modify and view mount tables Sub-task Resolved Gang Li  
          41.
          		 RBF: Cache datanode reports Sub-task Resolved Íñigo Goiri  
          42.
          		 RBF: Add xsl stylesheet for hdfs-rbf-default.xml Sub-task Resolved Takanobu Asanuma  
          43.
          		 RBF: TestRouterWebHDFSContractCreate failed Sub-task Resolved Takanobu Asanuma  
          44.
          		 RBF: Support NamenodeProtocol in the Router Sub-task Resolved Íñigo Goiri  
          45.
          		 RBF: Improve timeout RPC call mechanism Sub-task Resolved Íñigo Goiri  
          46.
          		 RBF: Wrong date information in list file(-ls) result Sub-task Resolved Dibyendu Karmakar  
          47.
          		 RBF: Support federation with no subclusters Sub-task Resolved Íñigo Goiri  
          48.
          		 RBF: Fix java doc for StateStoreFileSystemImpl Sub-task Resolved YR  
          49.
          		 RBF: Remove LinkedList From StateStoreFileImpl.java Sub-task Resolved David Mollitor  
          50.
          		 RBF: Fix dead links in RBF document Sub-task Resolved Chetna Chaudhari  
          51.
          		 RBF: Improve the error loggings for printing the stack trace Sub-task Resolved Yiqun Lin  
          52.
          		 RBF: getMountPointDates should fetch latest subdir time/date when parent dir is not present but /parent/child dirs are present in mount table Sub-task Resolved Dibyendu Karmakar  
          53.
          		 RBF: Add more router-related information to the UI Sub-task Resolved Wei Yan  
          54.
          		 RBF: Disabled Nameservice store API Sub-task Resolved Íñigo Goiri  
          55.
          		 RBF: Disable Nameservices from the federation Sub-task Resolved Íñigo Goiri  
          56.
          		 RBF: Show disabled name services in the UI Sub-task Resolved Íñigo Goiri  
          57.
          		 RBF: Add unit test TestStateStoreDisabledNameservice Sub-task Resolved Yiqun Lin  
          58.
          		 RBF: Reject requests when a Router is overloaded Sub-task Resolved Íñigo Goiri  
          59.
          		 RBF: Fix setSafeMode in the Router Sub-task Resolved Íñigo Goiri  
          60.
          		 RBF: Normalize paths (automatically) when adding, updating, removing or listing mount table entries Sub-task Resolved Ekanth Sethuramalingam  
          61.
          		 RBF: Adding trace support Sub-task Resolved Íñigo Goiri  
          62.
          		 Add toString() for RemoteMethod Sub-task Resolved Chao Sun  
          63.
          		 RBF: Configurable value in xml for async connection request queue size. Sub-task Resolved CR Hota  
          64.
          		 RBF: Router fails when threadIndex (in ConnectionPool) wraps around Integer.MIN_VALUE Sub-task Resolved CR Hota  
          65.
          		 RBF: Fix RBF configuration links Sub-task Resolved Takanobu Asanuma  
          66.
          		 RBF: Add Web UI configurations and descriptions to RBF document Sub-task Resolved Takanobu Asanuma  
          67.
          		 RBF: Router throws NullPointerException due to the invalid initialization of MountTableResolver Sub-task Resolved Takanobu Asanuma  
          68.
          		 RBF: Router ID in RouterRpcClient is always null Sub-task Resolved Takanobu Asanuma  
          69.
          		 [Documentation] RBF: Mount points across multiple subclusters Sub-task Resolved Íñigo Goiri  
          70.
          		 RBF: Move ClientProtocol APIs to its own module Sub-task Resolved Chao Sun  

          Activity

            People

              elgoiri Íñigo Goiri
              elgoiri Íñigo Goiri
              Votes:
              2 Vote for this issue
              Watchers:
              35 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 24h
                  24h
                  Remaining:
                  Remaining Estimate - 24h
                  24h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified