Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-21991

Fix MetaMetrics issues - [Race condition, Faulty remove logic], few improvements

    XMLWordPrintableJSON

Details

    • Incompatible change
    • Hide
      The class LossyCounting was unintentionally marked Public but was never intended to be part of our public API. This oversight has been corrected and LossyCounting is now marked as Private and going forward may be subject to additional breaking changes or removal without notice. If you have taken a dependency on this class we recommend cloning it locally into your project before upgrading to this release.
      Show
      The class LossyCounting was unintentionally marked Public but was never intended to be part of our public API. This oversight has been corrected and LossyCounting is now marked as Private and going forward may be subject to additional breaking changes or removal without notice. If you have taken a dependency on this class we recommend cloning it locally into your project before upgrading to this release.

    Description

      Here is a list of the issues related to the MetaMetrics implementation:

      Bugs:

      1. [_Lossy counting for top-k_] Faulty remove logic of non-eligible meters: Under certain conditions, we might end up storing/exposing all the meters rather than top-k-ish
      2. MetaMetrics can throw NPE resulting in aborting of the RS because of a Race Condition.

      Improvements:

      1. With high number of regions in the cluster, exposure of metrics for each region blows up the JMX from ~140 Kbs to 100+ Mbs depending on the number of regions. It's better to use lossy counting to maintain top-k for region metrics as well.
      2. As the lossy meters do not represent actual counts, I think, it'll be better to rename the meters to include "lossy" in the name. It would be more informative while monitoring the metrics and there would be less confusion regarding actual counts to lossy counts.

      Attachments

        1. hbase-21991.master.001.patch
          18 kB
          Sakthi
        2. hbase-21991.master.002.patch
          18 kB
          Sakthi
        3. hbase-21991.master.003.patch
          19 kB
          Sakthi
        4. hbase-21991.master.004.patch
          19 kB
          Sakthi
        5. hbase-21991.master.005.patch
          19 kB
          Sakthi
        6. hbase-21991.master.006.patch
          19 kB
          Sakthi
        7. hbase-21991.branch-1.001.patch
          19 kB
          Sakthi
        8. hbase-21991.branch-1.002.patch
          20 kB
          Sakthi
        9. hbase-21991.addendum.patch
          1 kB
          Sakthi

        Issue Links

          Activity

            People

              sakthi Sakthi
              sakthi Sakthi
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: