Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-21041

Memstore's heap size will be decreased to minus zero after flush

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.1.0, 2.0.1
    • 3.0.0-alpha-1, 2.2.0, 2.1.1, 2.0.2
    • None
    • None

    Description

      When creating an active mutable segment (MutableSegment) in memstore, MutableSegment's deep overheap (208 bytes) was added to its heap size, but not to the region's memstore's heap size. And so was the immutable segment(CSLMImmutableSegment) which the mutable segment turned into (additional 8 bytes ) later. So after one flush, the memstore's heapsize will be decreased to -216 bytes, The minus number will accumulate after every flush.
      CompactingMemstore has this problem too.

      We need to record the overhead for CSLMImmutableSegment and MutableSegment to the corresponding region's memstore size.

      For CellArrayImmutableSegment, CellChunkImmutableSegment and CompositeImmutableSegment , it is not necessary to do so, because inside CompactingMemstore, the overheads are already be taken care of when transfer a CSLMImmutableSegment into them.

      Attachments

        1. HBASE-21041.branch-2.0.001.patch
          17 kB
          Allan Yang
        2. HBASE-21041.branch-2.0.002.patch
          17 kB
          Allan Yang

        Activity

          People

            allan163 Allan Yang
            allan163 Allan Yang
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: