Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14969

Fix HDFS client unnecessary failover log printing

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Duplicate
    • 3.1.3
    • None
    • hdfs-client

    Description

      In multi-NameNodes scenario, suppose there are 3 NNs and the 3rd is ANN, and then a client starts rpc with the 1st NN, it will be silent when failover from the 1st NN to the 2nd NN, but when failover from the 2nd NN to the 3rd NN, it prints some unnecessary logs, in some scenarios, these logs will be very numerous:

      2019-11-07 11:35:41,577 INFO retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error
 at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:98)
 at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:2052)
 at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1459)
 ...

      Attachments

        Issue Links

          depends upon

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-14963 Add HDFS Client machine caching active namenode index mechanism.

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Patch Available
          is related to

          New Feature - A new feature of the product, which has yet to be developed. HDFS-6440 Support more than 2 NameNodes

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-15024 [SBN read] In FailoverOnNetworkExceptionRetry , Number of NameNodes as a condition of calculation of sleep time

          • Major - Major loss of function.
          • Open
          is superceded by

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-17116 Skip Retry INFO logging on first failover from a proxy

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              xudongcao Xudong Cao
              xudongcao Xudong Cao
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: