Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-23553

Snapshot referenced data files are deleted in some case

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0-alpha-1, 2.3.0, 2.2.3
    • snapshots
    • None

    Description

      We scan snapshot in our cluster and got following exception:

      java.io.IOException: java.io.IOException: java.io.FileNotFoundException: Unable to open link: org.apache.hadoop.hbase.io.HFileLink locations=[hdfs://tjwqsrv-galaxy98/hbase/tjwqsrv-galaxy98/data/default/galaxy_online_fds_object_table/06dd90d8540b56343859b63a6134450c/A/4dddda6cf05f419a9f61059cb05a962f, hdfs://tjwqsrv-galaxy98/hbase/tjwqsrv-galaxy98/.tmp/data/default/galaxy_online_fds_object_table/06dd90d8540b56343859b63a6134450c/A/4dddda6cf05f419a9f61059cb05a962f, hdfs://tjwqsrv-galaxy98/hbase/tjwqsrv-galaxy98/archive/data/default/galaxy_online_fds_object_table/06dd90d8540b56343859b63a6134450c/A/4dddda6cf05f419a9f61059cb05a962f] 
      at org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionStores(HRegion.java:867) 
      at org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:778) at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:749) 
      at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:5306) 
      at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:5271) 
      at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:5243) 
      at org.apache.hadoop.hbase.client.ClientSideRegionScanner.<init>(ClientSideRegionScanner.java:72) 
      at org.apache.hadoop.hbase.mapreduce.TableSnapshotInputFormatImpl$RecordReader.initialize(TableSnapshotInputFormatImpl.java:239) 
      at org.apache.hadoop.hbase.mapreduce.TableSnapshotInputFormat$TableSnapshotRegionRecordReader.initialize(TableSnapshotInputFormat.java:150) 
      at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:552) at 

      I checked to namenode logs and found that this file is deleted by hbase cleaner although a snapshot still referenced to this file.

       

      Attachments

        Issue Links

          Activity

            People

              meiyi Yi Mei
              meiyi Yi Mei
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: