Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-26193

Do not store meta region location as permanent state on zookeeper

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.5.0, 3.0.0-alpha-2
    • meta, Zookeeper
    • None
    • Reviewed
    • Hide
      Introduce a new 'info' family in master local region for storing the location of meta regions.
      We will still mirror the location of meta regions to ZooKeeper, for backwards compatibility. But now you can also clean the meta location znodes(usually prefixed with 'meta-region-server') on ZooKeeper without mess up the cluster state. You can get a clean restart of the cluster, and after restarting, we will mirror the location of meta regions to ZooKeeper again.
      Show
      Introduce a new 'info' family in master local region for storing the location of meta regions. We will still mirror the location of meta regions to ZooKeeper, for backwards compatibility. But now you can also clean the meta location znodes(usually prefixed with 'meta-region-server') on ZooKeeper without mess up the cluster state. You can get a clean restart of the cluster, and after restarting, we will mirror the location of meta regions to ZooKeeper again.

    Description

      As it breaks one of our design rules

      https://hbase.apache.org/book.html#design.invariants.zk.data

      We used to think hbase should be recovered automatically when all the data on zk (except the replication data) are cleared, but obviously, if you clear the meta region location, the cluster will be in trouble, and need to use operation tools to recover the cluster.

      So here, along with the ConnectionRegistry improvements, we should also consider move the meta region location off zookeeper.

      Attachments

        Issue Links

          is related to

          Sub-task - The sub-task of the issue HBASE-24388 Store the locations of meta regions in master local store

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-24286 HMaster won't become healthy after after cloning or creating a new cluster pointing at the same file system

          • Major - Major loss of function.
          • Resolved
          relates to

          Task - A task that needs to be done. HBASE-26285 Remove MetaTableLocator usages in non-migration code

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. HBASE-26288 Revisit the usage of MetaTableLocator when HRegionServer.TEST_SKIP_REPORTING_TRANSITION is true

          • Major - Major loss of function.
          • Resolved

          Umbrella - An overarching type made of sub-tasks HBASE-25382 Super Split Meta

          • Major - Major loss of function.
          • Open
          links to

          Web Link Design Doc

          Web Link GitHub Pull Request #3583

          Activity

            People

              zhangduo Duo Zhang
              zhangduo Duo Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: