Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8825 Enhancements to Balancer
  3. HDFS-8876

Make hard coded parameters used by balancer and other tools configurable

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      During investigation of how to speed up balancer, at least to the level specified by dfs.datanode.balance.bandwidthPerSec, we found that parameters such as MAX_BLOCKS_SIZE_TO_FETCH and SOURCE_BLOCKS_MIN_SIZE are hard coded. These parameters are related to block size and other configurable parameters used by balancer. So least we should make it configurable. In the longer term, it might be interesting to understand if we simplify all these related configurations.

      Attachments

        Activity

          People

            ctrezzo Chris Trezzo
            mingma Ming Ma
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated: