Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-17047

BlockManager#addStoredBlock should log storage id when AddBlockResult is REPLACED

    XMLWordPrintableJSON

Details

    • Wish
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.4.0
    • 3.4.0
    • hdfs
    • Reviewed

    Description

      Recently, we found some logs in active namenode frequently like belows:

       

      2023-06-12 05:34:09,821 WARN BlockStateChange: BLOCK* addStoredBlock: block blk_-9223372036614126544_57136788 moved to storageType DISK on node datanode1:50010
2023-06-12 05:34:09,892 WARN BlockStateChange: BLOCK* addStoredBlock: block blk_-9223372036614126544_57136788 moved to storageType DISK on node datanode1:50010
2023-06-12 11:34:07,932 WARN BlockStateChange: BLOCK* addStoredBlock: block blk_-9223372036614126544_57136788 moved to storageType DISK on node datanode1:50010
2023-06-12 11:34:08,027 WARN BlockStateChange: BLOCK* addStoredBlock: block blk_-9223372036614126544_57136788 moved to storageType DISK on node datanode1:50010
2023-06-12 17:34:08,742 WARN BlockStateChange: BLOCK* addStoredBlock: block blk_-9223372036614126544_57136788 moved to storageType DISK on node datanode1:50010
2023-06-12 17:34:08,813 WARN BlockStateChange: BLOCK* addStoredBlock: block blk_-9223372036614126544_57136788 moved to storageType DISK on node datanode1:50010
2023-06-12 23:34:09,752 WARN BlockStateChange: BLOCK* addStoredBlock: block blk_-9223372036614126544_57136788 moved to storageType DISK on node datanode1:50010
2023-06-12 23:34:09,812 WARN BlockStateChange: BLOCK* addStoredBlock: block blk_-9223372036614126544_57136788 moved to storageType DISK on node datanode1:50010
2023-06-13 05:34:08,065 WARN BlockStateChange: BLOCK* addStoredBlock: block blk_-9223372036614126544_57136788 moved to storageType DISK on node datanode1:50010
2023-06-13 05:34:08,144 WARN BlockStateChange: BLOCK* addStoredBlock: block blk_-9223372036614126544_57136788 moved to storageType DISK on node datanode1:50010
2023-06-13 11:34:08,638 WARN BlockStateChange: BLOCK* addStoredBlock: block blk_-9223372036614126544_57136788 moved to storageType DISK on node datanode1:50010
2023-06-13 11:34:08,681 WARN BlockStateChange: BLOCK* addStoredBlock: block blk_-9223372036614126544_57136788 moved to storageType DISK on node datanode1:50010

       

       

      All logs have the same ec block id : blk_-9223372036614126544_57136788  and printed every 6 hours(FBR interval of our cluster).

      To figure out what happened, I think we should also log storage id here.

      Attachments

        Issue Links

          links to

          Web Link GitHub Pull Request #5742

          Activity

            People

              zhanghaobo farmmamba
              zhanghaobo farmmamba
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: