Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-8399

Erasure Coding: unit test the behaviour of BlockManager recovery work for the deleted blocks

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • HDFS-7285
    • None
    • Reviewed

    Description

      Following exception occurred in the ReplicationMonitor. As per the initial analysis, I could see the exception is coming for the blocks of the deleted file.

      2015-05-14 14:14:40,485 FATAL util.ExitUtil (ExitUtil.java:terminate(127)) - Terminate called
      org.apache.hadoop.util.ExitUtil$ExitException: java.lang.AssertionError: Absolute path required
      	at org.apache.hadoop.hdfs.server.namenode.INode.getPathNames(INode.java:744)
      	at org.apache.hadoop.hdfs.server.namenode.INode.getPathComponents(INode.java:723)
      	at org.apache.hadoop.hdfs.server.namenode.FSDirectory.getINodesInPath(FSDirectory.java:1655)
      	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getECSchemaForPath(FSNamesystem.java:8435)
      	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.computeRecoveryWorkForBlocks(BlockManager.java:1572)
      	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.computeBlockRecoveryWork(BlockManager.java:1402)
      	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.computeDatanodeWork(BlockManager.java:3894)
      	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor.run(BlockManager.java:3846)
      	at java.lang.Thread.run(Thread.java:722)
      
      	at org.apache.hadoop.util.ExitUtil.terminate(ExitUtil.java:126)
      	at org.apache.hadoop.util.ExitUtil.terminate(ExitUtil.java:170)
      	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor.run(BlockManager.java:3865)
      	at java.lang.Thread.run(Thread.java:722)
      Exception in thread "org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor@1255079" org.apache.hadoop.util.ExitUtil$ExitException: java.lang.AssertionError: Absolute path required
      	at org.apache.hadoop.hdfs.server.namenode.INode.getPathNames(INode.java:744)
      	at org.apache.hadoop.hdfs.server.namenode.INode.getPathComponents(INode.java:723)
      	at org.apache.hadoop.hdfs.server.namenode.FSDirectory.getINodesInPath(FSDirectory.java:1655)
      	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getECSchemaForPath(FSNamesystem.java:8435)
      	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.computeRecoveryWorkForBlocks(BlockManager.java:1572)
      	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.computeBlockRecoveryWork(BlockManager.java:1402)
      	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.computeDatanodeWork(BlockManager.java:3894)
      	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor.run(BlockManager.java:3846)
      	at java.lang.Thread.run(Thread.java:722)
      
      	at org.apache.hadoop.util.ExitUtil.terminate(ExitUtil.java:126)
      	at org.apache.hadoop.util.ExitUtil.terminate(ExitUtil.java:170)
      	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$ReplicationMonitor.run(BlockManager.java:3865)
      	at java.lang.Thread.run(Thread.java:722)
      

      Attachments

        1. HDFS-8399-HDFS-7285-00.patch
          6 kB
          Rakesh Radhakrishnan
        2. HDFS-8399-HDFS-7285-01.patch
          5 kB
          Rakesh Radhakrishnan
        3. HDFS-8399-HDFS-7285-02.patch
          5 kB
          Rakesh Radhakrishnan

        Activity

          People

            rakeshr Rakesh Radhakrishnan
            rakeshr Rakesh Radhakrishnan
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: