Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14271

[SBN read] StandbyException is logged if Observer is the first NameNode

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Minor
    • Resolution: Unresolved
    • 3.3.0
    • None
    • hdfs

    Description

      If I transition the first NameNode into Observer state, and then I create a file from command line, it prints the following StandbyException log message, as if the command failed. But it actually completed successfully:

      [root@weichiu-sbsr-1 ~]# hdfs dfs -touchz /tmp/abf
19/02/12 16:35:17 INFO retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category WRITE is not supported in state observer. Visit https://s.apache.org/sbnn-error
	at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:98)
	at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1987)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1424)
	at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.create(NameNodeRpcServer.java:762)
	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.create(ClientNamenodeProtocolServerSideTranslatorPB.java:458)
	at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:530)
	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1070)
	at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:918)
	at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:853)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1729)
	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2782)
, while invoking $Proxy4.create over [weichiu-sbsr-1.gce.cloudera.com/172.31.121.145:8020,weichiu-sbsr-2.gce.cloudera.com/172.31.121.140:8020]. Trying to failover immediately.

      This is unlike the case when the first NameNode is the Standby, where this StandbyException is suppressed.

      Attachments

        1. HDFS-14271_1.patch
          1 kB
          Shen Yinjie
        2. image-2022-03-11-14-54-49-806.png
          1.50 MB
          Tao Li

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. HDFS-12943 Consistent Reads from Standby Node

          • Major - Major loss of function.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-14855 client always print standbyexception info with multi standby namenode

          • Major - Major loss of function.
          • Open

          Activity

            People

              shenyinjie Shen Yinjie
              weichiu Wei-Chiu Chuang
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated: