Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-27464

In memory compaction 'COMPACT' may cause data corruption when adding cells large than maxAlloc(default 256k) size

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      When init 'CellChunkImmutableSegment' for 'COMPACT' action, we not force copy to current MSLab. 

      When cell size bigger than maxAlloc, cell will stay in previous chunk which will recycle after segment replace, and we may read wrong data when these chunk reused by others.

       

      Timeline:

      1. add a cell 'A' bigger than 256K
      2. cell 'A' will copy to a chunk 'A' when first compact
      3. cell 'A' will retain in chunk 'A' when second compact
      4. chunk 'A' recycled after segment swap and close

      Attachments

        1. image-2022-11-04-15-46-21-645.png
          115 kB
          zhuobin zheng

        Issue Links

          Activity

            People

              comnetwork chenglei
              zhengzhuobinzzb zhuobin zheng
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: