Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-27805

The chunk created by mslab may cause memory fragement and lead to fullgc

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 4.0.0-alpha-1
    • documentation
    • None

    Description

      The default size of chunk is 2m, when we use G1, if heapRegionSize equals 4m, these chunks are allocated as humongous objects, exclusively allocating one region, then the remaining 2m become memory fragement.

      Lots of memory fragement may lead to fullgc even if the percent of used heap not high enough.

      I have tested to reduce the chunk size to 2047k(2m-1k, a bit lesser than half of heapRegionSize), there was no repeat of the above.

      BTW, in G1, humongous objects are objects larger or equal the size of half a region, and the heapRegionSize is automatically calculated based on the heap size parameter if not explicitly specified.

       

      Attachments

        1. chunksize-2047k.png
          386 kB
          Zheng Wang
        2. chunksize-2048k-fullgc.png
          406 kB
          Zheng Wang

        Issue Links

          Activity

            People

              filtertip Zheng Wang
              filtertip Zheng Wang
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: