Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-22163

Should not archive the compacted store files when region warmup

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • 3.0.0-alpha-1, 2.2.0, 2.3.0
    • 3.0.0-alpha-1, 2.2.0, 2.3.0
    • None
    • None

    Description

      Found this problem when run ITBLL for branch-2.2.

      The master log shows that it try to move a splited parent region.

      2019-04-03,12:56:13,635 INFO org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Finished pid=2823, state=SUCCESS; SplitTableRegionProcedure table=IntegrationTestBigLinkedList, parent=a777f8fab6d17d37aaec842ba6035ad5, daughterA=634feb79a583480597e1843647d11228, daughterB=e370e6013ad35b83471671f2374278ab in 2.5930sec

2019-04-03,12:56:23,344 INFO org.apache.hadoop.hbase.master.HMaster: Client=hdfs_tst_admin//10.142.58.8 move hri=a777f8fab6d17d37aaec842ba6035ad5, source=, destination=c4-hadoop-tst-st30.bj,29100,1554265874772, running balancer

      And the regionserver will try to open the stores of this region. After HBASE-20724, the compated store file will be archived when open the stroes. But there are still have reference for these file in daughter regions' store dir. Then the daughter region will can't open because file not found.....

       

      Attachments

        1. HBASE-22163.master.002.patch
          25 kB
          Guanghao Zhang
        2. HBASE-22163.master.002.patch
          25 kB
          Guanghao Zhang
        3. HBASE-22163.master.001.patch
          20 kB
          Guanghao Zhang

        Issue Links

          fixes

          Bug - A problem which impairs or prevents the functions of the product. HBASE-26722 Snapshot is corrupted due to interaction between move, warmupRegion, compaction, and HFileArchiver

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue HBASE-27974 CompactionServer cause the loss of HFile references in snapshot

          • Major - Major loss of function.
          • Open
          links to

          Web Link GitHub Pull Request #122

          Activity

            People

              zghao Guanghao Zhang
              zghao Guanghao Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: