Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11625

Reading datablock throws "Invalid HFile block magic" and can not switch to hdfs checksum

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.94.21, 0.98.4, 0.98.5, 1.0.1.1, 1.0.3
    • 1.3.0, 1.2.2, 1.1.6, 2.0.0
    • HFile
    • None

    Description

      when using hbase checksum,call readBlockDataInternal() in hfileblock.java, it could happen file corruption but it only can switch to hdfs checksum inputstream till validateBlockChecksum(). If the datablock's header corrupted when b = new HFileBlock(),it throws the exception "Invalid HFile block magic" and the rpc call fail

      Attachments

        1. 2711de1fdf73419d9f8afc6a8b86ce64.gz
          4.30 MB
          Paul Fleetwood
        2. HBASE-11625.patch
          0.8 kB
          Pankaj Kumar
        3. correct-hfile
          1 kB
          Apekshit Sharma
        4. corrupted-header-hfile
          1 kB
          Apekshit Sharma
        5. HBASE-11625-master.patch
          16 kB
          Apekshit Sharma
        6. HBASE-11625-master-v2.patch
          18 kB
          Apekshit Sharma
        7. HBASE-11625-master-v3.patch
          18 kB
          Apekshit Sharma
        8. HBASE-11625-branch-1-v1.patch
          18 kB
          Apekshit Sharma
        9. HBASE-11625-branch-1.2-v1.patch
          27 kB
          Apekshit Sharma
        10. HBASE-11625-branch-1.2-v2.patch
          27 kB
          Apekshit Sharma
        11. HBASE-11625-branch-1.2-v3.patch
          27 kB
          Apekshit Sharma
        12. HBASE-11625-branch-1.2-v4.patch
          27 kB
          Apekshit Sharma
        13. HBASE-11625.branch-1.1.001.patch
          30 kB
          Apekshit Sharma

        Issue Links

          Activity

            People

              appy Apekshit Sharma
              qian wang qian wang
              Votes:
              0 Vote for this issue
              Watchers:
              22 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: