Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-20610

Procedure V2 - Distributed Log Splitting

    XMLWordPrintableJSON

Details

    • Umbrella
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0-alpha-1, 2.2.0
    • proc-v2
    • None
    • Reviewed
    • See RN in HBASE-21588 for detail on this feature. It landed in hbase-2.2.0.

    Description

      Now master and regionserver use zk to coordinate log split tasks. The split log manager manages all log files which need to be scanned and split. Then the split log manager places all the logs into the ZooKeeper splitWAL node (/hbase/splitWAL) as tasks and monitors these task nodes and waits for them to be processed. Each regionserver watch splitWAL znode and grab task when node children changed. And regionserver does the work to split the logs.

      Open this umbrella issue to move this "coordinate" work to use new procedure v2 framework and reduce zk depencency. Plan to finish this before 3.0 release. Any suggestions are welcomed. Thanks.

      Attachments

        1. HBASE-20610.master.001.patch
          47 kB
          Jingyun Tian

        Issue Links

          There are no Sub-Tasks for this issue.

          Activity

            People

              tianjingyun Jingyun Tian
              zghao Guanghao Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: