Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6441

Add ability to exclude/include specific datanodes while balancing

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.4.0
    • 2.6.0
    • balancer & mover
    • None
    • Reviewed

    Description

      In some use cases, it is desirable to ignore a few data nodes while balancing. The administrator should be able to specify a list of data nodes in a file similar to the hosts file and the balancer should ignore these data nodes while balancing so that no blocks are added/removed on these nodes.

      Similarly it will be beneficial to specify that only a particular list of datanodes should be considered for balancing.

      Attachments

        1. HDFS-6441.patch
          13 kB
          Benoy Antony
        2. HDFS-6441.patch
          17 kB
          Benoy Antony
        3. HDFS-6441.patch
          17 kB
          Benoy Antony
        4. HDFS-6441.patch
          17 kB
          Benoy Antony
        5. HDFS-6441.patch
          18 kB
          Benoy Antony
        6. HDFS-6441.patch
          19 kB
          Benoy Antony
        7. HDFS-6441.patch
          19 kB
          Benoy Antony
        8. HDFS-6441.patch
          19 kB
          Benoy Antony
        9. HDFS-6441.patch
          20 kB
          Benoy Antony
        10. HDFS-6441.patch
          25 kB
          Benoy Antony
        11. HDFS-6441.patch
          37 kB
          Benoy Antony
        12. HDFS-6441.patch
          38 kB
          Benoy Antony
        13. HDFS-6441.patch
          39 kB
          Benoy Antony
        14. HDFS-6441.patch
          39 kB
          Benoy Antony

        Issue Links

          is depended upon by

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-6798 Add test case for incorrect data node condition during balancing

          • Major - Major loss of function.
          • Closed
          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-6010 Make balancer able to balance data among specified servers

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-6364 Incorrect check for unknown datanode in Balancer

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. HBASE-4755 HBase based block placement in DFS

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              benoyantony Benoy Antony
              benoyantony Benoy Antony
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: