Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14720

DataNode shouldn't report block as bad block if the block length is Long.MAX_VALUE.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.1.1
    • 3.3.0, 3.1.4, 3.2.2
    • datanode
    • None

    Description

      2019-08-11 09:15:58,092 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Can't replicate block BP-725378529-10.0.0.8-1410027444173:blk_13276745777_1112363330268 because on-disk length 175085 is shorter than NameNode recorded length 9223372036854775807.

      If the block length is Long.MAX_VALUE, means file belongs to this block is deleted from the namenode and DN got the command after deletion of file. In this case command should be ignored.

      Attachments

        1. HDFS-14720.001.patch
          2 kB
          Hemanth Boyina
        2. HDFS-14720.002.patch
          2 kB
          Hemanth Boyina
        3. HDFS-14720.003.patch
          2 kB
          Hemanth Boyina

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. HDFS-13638 DataNode Can't replicate block because NameNode thinks the length is 9223372036854775807

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-10453 ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDFS-13663 Should throw exception when incorrect block size is set

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue HDFS-14794 [SBN read] reportBadBlock is rejected by Observer.

          • Major - Major loss of function.
          • Open

          Activity

            People

              hemanthboyina Hemanth Boyina
              surendralilhore Surendra Singh Lilhore
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: