Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-22300

SLB doesn't perform well with increase in number of regions

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Balancer
    • Labels:

      Description

      With increase in number of regions in a cluster the number of steps taken by balancer in 30 sec (default balancer runtime) reduces noticeably. The following is the number of steps taken with by balancer with region loads set and running it without the loads being set i.e. cost functions using region loads are not fully exercised.

      Nodes  regions  Tables    # of steps           # of steps 
                                with RS Load         With no load   
      5       50       5        200000               200000
      100     2000     110      104707               1000000                          
      100     10000    40       19911                1000000                          
      200     100000   400      870                  1000000                          

      As one would expect the reduced number of steps also makes the balancer take long time to get to an optimal cost. Note that only 2 data points were used in the region load histogram while in practice 15 region load data points are remembered.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              gsbiju Biju Nair
            • Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated: