Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-15531

Favored Nodes Enhancements

    XMLWordPrintableJSON

Details

    • Umbrella
    • Status: Closed
    • Major
    • Resolution: Implemented
    • None
    • None
    • None
    • None

    Description

      We been working on enhancing favored nodes at Yahoo! See draft document. Feel free to comment. I'll add more info.

      https://docs.google.com/document/d/1948RKX_-kGUNOHjiYFiKPZnmKWybJkahJYsNibVhcCk/edit?usp=sharing

      These enhancements have recently started running in production.

      Attachments

        Issue Links

          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-21014 Improve Stochastic Balancer to write HDFS favoured node hints for region primary blocks to avoid destroying data locality if needing to use HDFS Balancer

          • Major - Major loss of function.
          • Open
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-17760 HDFS Balancer doc is misleading

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. HBASE-13021 Pin regions blocks to avoid HDFS balancing

          • Major - Major loss of function.
          • Closed
          supercedes

          New Feature - A new feature of the product, which has yet to be developed. HBASE-4755 HBase based block placement in DFS

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          links to

          Web Link Favored Nodes v2 - design document

          1.
          		 Support first assignment of split daughters to non-parent RS Sub-task Closed Unassigned
          2.
          		 core favored nodes enhancements Sub-task Closed Unassigned
          3.
          		 Add RSGroup Favored Balancer Sub-task Closed Unassigned
          4.
          		 FavoredNodes - Split/Merge code paths Sub-task Closed Thiruvel Thirumoolan
          5.
          		 Add FavoredStochasticLoadBalancer and FN Candidate generators Sub-task Closed Thiruvel Thirumoolan
          6.
          		 FN Interfaces for writing tools for monitoring/operations Sub-task Closed Unassigned
          7.
          		 Refactor FavoredNodePlan to use regionNames as keys Sub-task Closed Thiruvel Thirumoolan
          8.
          		 Implement Chore to sync FN info from Master to RegionServers Sub-task Closed Unassigned
          9.
          		 FavoredNodes should not apply to system tables Sub-task Closed Thiruvel Thirumoolan
          10.
          		 FN info should be cleaned up on region/table cleanup Sub-task Closed Thiruvel Thirumoolan
          11.
          		 Add FavoredNode checks to hbck -checkFavoredNodes Sub-task Closed Unassigned
          12.
          		 Split/Merge - Update of FN info along with regionState change Sub-task Closed Unassigned
          13.
          		 FN updates during region merge (follow up to Procedure v2 merge) Sub-task Closed Thiruvel Thirumoolan
          14.
          		 Refactor StartcodeAgnosticServerName so it doesn't extend ServerName Sub-task Closed Unassigned
          15.
          		 FN should use datanode port from hdfs configuration Sub-task Closed Thiruvel Thirumoolan
          16.
          		 Add integration tests for FavoredNodes feature Sub-task Closed Unassigned
          17.
          		 Adding FN documentation to reference guide Sub-task Closed Unassigned
          18.
          		 Move table to another group (add -migrateTertiary) Sub-task Closed Unassigned
          19.
          		 Refactor HRegionServer to use regionNames as keys for FN Sub-task Closed Unassigned
          20.
          		 Admin API to update favored nodes in Master Sub-task Closed Unassigned
          21.
          		 Tools/API to read favored nodes for region(s) Sub-task Closed Unassigned
          22.
          		 Tools/Admin API to dump the replica load of server(s) Sub-task Closed Unassigned
          23.
          		 Follow up enhancements for Favored nodes pickers Sub-task Closed Unassigned
          24.
          		 Admin API to removeFavoredNode on node decommission Sub-task Closed Unassigned
          25.
          		 Admin API to check for favored nodes Sub-task Closed Unassigned
          26.
          		 Admin API to redistribute Favored Nodes Sub-task Closed Unassigned
          27.
          		 Admin API to do complete redistribute of favored nodes Sub-task Closed Unassigned

          Activity

            People

              Unassigned Unassigned
              toffer Francis Christopher Liu
              Votes:
              0 Vote for this issue
              Watchers:
              28 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: