Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-21594

Requested block is out of range when reading hfile

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.98.10
    • Fix Version/s: None
    • Component/s: HFile
    • Labels:
      None

      Description

      My HFiles are generated by Spark HBaseBulkLoad. And then when i read a few of them(or hbase do compact), i encounter the following exceptions.

       

      Exception in thread "main" java.io.IOException: Requested block is out of range: 77329641, lastDataBlockOffset: 77329641, trailer.getLoadOnOpenDataOffset: 77329641
      at org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:396)
      at org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.readNextDataBlock(HFileReaderV2.java:734)
      at org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.isNextBlock(HFileReaderV2.java:859)
      at org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.positionForNextBlock(HFileReaderV2.java:854)
      at org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2._next(HFileReaderV2.java:871)
      at org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.next(HFileReaderV2.java:891)
      at io.patamon.hbase.test.read.TestHFileRead.main(TestHFileRead.java:49)
      

      Looks like `lastDataBlockOffset` is equals to `trailer.getLoadOnOpenDataOffset`. Could anyone help me? Thanks very much.

       

        Attachments

        1. image-2018-12-13-20-11-00-818.png
          507 kB
          ChenKai
        2. 2e4db6a7f8d14f2bb846781b07750dc1_SeqId_84_.bak
          32.14 MB
          ChenKai
        3. image-2018-12-18-22-40-20-930.png
          2.37 MB
          ChenKai

          Activity

            People

            • Assignee:
              openinx Zheng Hu
              Reporter:
              514793425@qq.com ChenKai
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: