Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-27302

Adding a trigger for Stochastica Balancer to safeguard for upper bound outliers.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Balancer
    • None

    Description

      In large clusters, if one outlier has a lot of regions, the calculated imbalance for  RegionCountSkewCostFunction is quite low and often fails to trigger the balancer.

      For example, a node with twice average count on a 400-node cluster only produce an imbalance of 0.004 < 0.02(current default threshold to trigger balancer). An empty node also have similar effect but we have a safeguard in place. https://issues.apache.org/jira/browse/HBASE-24139

      We can add a safeguard for this so  we don't have to lower threshold on larger clusters that makes the balancer more sensitive to other minor imbalances.

      Attachments

        Issue Links

          is a child of

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-25697 StochasticBalancer improvement for large scale clusters

          • Major - Major loss of function.
          • Open
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-25625 StochasticBalancer CostFunctions needs a better way to evaluate region count distribution

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-24139 Balancer should avoid leaving idle region servers

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              claraxiong Clara Xiong
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: