Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-18005

read replica: handle the case that region server hosting both primary replica and meta region is down

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.4.0, 2.0.0
    • None
    • None
    • Reviewed

    Description

      Identified one corner case in testing that when the region server hosting both primary replica and the meta region is down, the client tries to reload the primary replica location from meta table, it is supposed to clean up only the cached location for specific replicaId, but it clears caches for all replicas. Please see

      https://github.com/apache/hbase/blob/master/hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java#L813

      Since it takes some time for regions to be reassigned (including meta region), the following may throw exception

      https://github.com/apache/hbase/blob/master/hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCallerWithReadReplicas.java#L173

      This exception needs to be caught and it needs to get cached location (in this case, the primary replica's location is not available). If there are cached locations for other replicas, it can still go ahead to get stale values from secondary replicas.

      With meta replica, it still helps to not clean up the caches for all replicas as the info from primary meta replica is up-to-date.

      Attachments

        1. HBASE-18005-branch-1-v001.patch
          19 kB
          Hua Xiang
        2. HBASE-18005-master-001.patch
          23 kB
          Hua Xiang
        3. HBASE-18005-master-002.patch
          25 kB
          Hua Xiang
        4. HBASE-18005-master-003.patch
          25 kB
          Hua Xiang
        5. HBASE-18005-master-004.patch
          19 kB
          Hua Xiang
        6. HBASE-18005-master-005.patch
          19 kB
          Hua Xiang
        7. HBASE-18005-master-006.patch
          19 kB
          Hua Xiang

        Issue Links

          Activity

            People

              huaxiang Hua Xiang
              huaxiang Hua Xiang
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: