Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-23066 Create a config that forces to cache blocks on compaction
  3. HBASE-23350

Make compaction files cacheonWrite configurable based on threshold

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0-alpha-1, 2.3.0
    • Compaction
    • None
    • Hide
      This JIRA adds a new configuration - `hbase.rs.cachecompactedblocksonwrite.threshold`. This configuration is the maximum total size (in bytes) of the compacted files below which the configuration `hbase.rs.cachecompactedblocksonwrite` is honoured. If the total size of the compacted fies exceeds this threshold, even when `hbase.rs.cachecompactedblocksonwrite` is enabled, the data blocks are not cached. Caching index and bloom blocks is not affected by this configuration (user configuration is always honoured).

      Default value of this configuration is Long.MAX_VALUE. This means whatever the total size of the compacted files, it wil be cached.
      Show
      This JIRA adds a new configuration - `hbase.rs.cachecompactedblocksonwrite.threshold`. This configuration is the maximum total size (in bytes) of the compacted files below which the configuration `hbase.rs.cachecompactedblocksonwrite` is honoured. If the total size of the compacted fies exceeds this threshold, even when `hbase.rs.cachecompactedblocksonwrite` is enabled, the data blocks are not cached. Caching index and bloom blocks is not affected by this configuration (user configuration is always honoured). Default value of this configuration is Long.MAX_VALUE. This means whatever the total size of the compacted files, it wil be cached.

    Description

      As per comment from javaman_chen in the parent JIRA
      https://issues.apache.org/jira/browse/HBASE-23066?focusedCommentId=16937361&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16937361
      This is to introduce a config to identify if the resulting compacted file's blocks should be added to the cache - while writing.

      Attachments

        Issue Links

          Activity

            People

              abhinaba.sarkar Abhinaba Sarkar
              ram_krish ramkrishna.s.vasudevan
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: