Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-8987

Erasure coding: MapReduce job failed when I set the / folder to the EC zone

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 3.0.0-alpha1
    • None
    • erasure-coding
    • None

    Description

      Test progress is as follows

      • For a new cluster, I format the namenode and then start HDFS service.
      • After HDFS service is started, there is no files in HDFS and set the / folder to the EC zone. the EC zone is created successfully.
      • Start the yarn and mr JobHistoryServer services. All the services start successfully.
      • Then run hadoop example pi program and it failed.

      The following is the exception.

       ```
      org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.namenode.UnsupportedActionException): Cannot set replication to a file with striped blocks
      	at org.apache.hadoop.hdfs.server.namenode.FSDirAttrOp.unprotectedSetReplication(FSDirAttrOp.java:391)
      	at org.apache.hadoop.hdfs.server.namenode.FSDirAttrOp.setReplication(FSDirAttrOp.java:151)
      	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.setReplication(FSNamesystem.java:2231)
      	at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.setReplication(NameNodeRpcServer.java:682)
      	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.setReplication(ClientNamenodeProtocolServerSideTranslatorPB.java:445)
      	at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
      	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:636)
      	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:976)
      	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2171)
      	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2167)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at javax.security.auth.Subject.doAs(Subject.java:422)
      	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1666)
      	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2165)
      
      ```
      

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              Lifeng Wang Lifeng Wang
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: