Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-24273

HBCK's "Orphan Regions on FileSystem" reports regions with referenced HFiles

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 2.2.4
    • 3.0.0-alpha-1, 2.3.0, 2.2.5
    • hbck2
    • None
    • HBase 2.2.4

      Hadoop 3.1.3

    Description

      This issue came up after merging regions. MergeTableRegionsProcedure removes the parent regions from hbase:meta and creates HFile references in child region to the old parent regions. Running `hbck_chore_run` right after the `merge_region` will show the parent regions in "Orphan Regions on FileSystem" until major compaction is run on child region which will remove HFile references and cause Catalog Janitor to clean up the parent regions.

      There are probably other situations which can cause the same issue (maybe region split?)

      Having "Orphan Regions on FileSystem" list parent regions and suggest to "hbase completebulkload" is dangerous in this case as completing bulk load will lead to stale HFile references in child region which will cause its OPEN to fail because referenced HFile doesn't exist.

      Figuring out these things for database administrators is tedious, so I think it would be reasonable to not consider regions with referenced HFiles to be orphans (or maybe could give an extra hint saying that it has referenced HFiles).

      Attachments

        Activity

          People

            huaxiangsun Huaxiang Sun
            timoha Andrey Elenskiy
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: