Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-15240 Go Big BucketCache Fixes
  3. HBASE-15640

L1 cache doesn't give fair warning that it is showing partial stats only when it hits limit

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.3.0, 0.98.19, 1.2.2, 2.0.0
    • BlockCache
    • None
    • Reviewed
    • Hide
      The blockcache UI tab would stop refreshing at 100k blocks (configurable, see "hbase.ui.blockcache.by.file.max"), which isn't very many blocks when doing a big cache, giving a misleading picture of the content of L1 and/or L2 cache. Up the default limit to 1M blocks (UI takes a while but just a few seconds counting over 1M blocks).

      Also, when beyond the limit give the user a noticeable WARNING in the UI.
      Show
      The blockcache UI tab would stop refreshing at 100k blocks (configurable, see "hbase.ui.blockcache.by.file.max"), which isn't very many blocks when doing a big cache, giving a misleading picture of the content of L1 and/or L2 cache. Up the default limit to 1M blocks (UI takes a while but just a few seconds counting over 1M blocks). Also, when beyond the limit give the user a noticeable WARNING in the UI.

    Description

      I was baffled looking at L1 Cache because it was stuck at 100k blocks and only 'loading' 3G of data according to the UI. When I looked in log, all the numbers looked write in the Cache summary reported in log.

      Turns out our buckecache UI template will cut off calculating stats at a limit --which is probably what we want – but the fact that it has done this should be more plain.

      Attachments

        1. 15640.patch
          6 kB
          Michael Stack
        2. bc.ui.patch
          2 kB
          Michael Stack
        3. bc.ui.v3.patch
          2 kB
          Michael Stack
        4. bc.ui (1).patch
          2 kB
          Michael Stack
        5. Screen Shot 2016-04-12 at 4.21.50 PM.png
          30 kB
          Michael Stack

        Activity

          People

            stack Michael Stack
            stack Michael Stack
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: