Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-28447

New site configuration option "hfile.block.size"

    XMLWordPrintableJSON

Details

    Description

      Right now there is no config attached to the HFile block size by which we can override the default. The default is set to 64 KB in HConstants.DEFAULT_BLOCKSIZE . We need a global config property that would go on hbase-site.xm which can control this value.

      Since the BLOCKSIZE is tracked at the column family level - we will need to respect the CFD value first. Also, configuration settings are also something that can be set in schema, at the column or table level, and will override the relevant values from the site file. Below is the precedence order we can use to get the final blocksize value :

      ColumnFamilyDescriptor.BLOCKSIZE > schema level site configuration overrides > site configuration > HConstants.DEFAULT_BLOCKSIZE

      PS: There is one related config “hbase.mapreduce.hfileoutputformat.blocksize” however that is specific to map-reduce jobs.

      Attachments

        Issue Links

          Activity

            People

              apurtell Andrew Kyle Purtell
              gourab.taparia Gourab Taparia
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated: