Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-14909

Netty IOExceptions caused by unclean client disconnects being logged at INFO instead of TRACE

    XMLWordPrintableJSON

Details

    • Low

    Description

      Observed spam logs on 3.0.17 cluster with redundant Netty IOExceptions caused due to client-side disconnections.

      INFO  [epollEventLoopGroup-2-28] 2018-11-20 23:23:04,386 Message.java:619 - Unexpected exception during request; channel = [id: 0x12995bc1, L:/xxx.xx.xxx.xxx:7104 - R:/xxx.xx.xxx.xxx:33754]
      io.netty.channel.unix.Errors$NativeIoException: syscall:read(...)() failed: Connection reset by peer
      	at io.netty.channel.unix.FileDescriptor.readAddress(...)(Unknown Source) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
      
      INFO  [epollEventLoopGroup-2-23] 2018-11-20 13:16:33,263 Message.java:619 - Unexpected exception during request; channel = [id: 0x98bd7c0e, L:/xxx.xx.xxx.xxx:7104 - R:/xxx.xx.xx.xx:33350]
      io.netty.channel.unix.Errors$NativeIoException: readAddress() failed: Connection timed out
      	at io.netty.channel.unix.Errors.newIOException(Errors.java:117) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
      	at io.netty.channel.unix.Errors.ioResult(Errors.java:138) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
      	at io.netty.channel.unix.FileDescriptor.readAddress(FileDescriptor.java:175) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
      	at io.netty.channel.epoll.AbstractEpollChannel.doReadBytes(AbstractEpollChannel.java:238) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
      	at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:926) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
      	at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:397) [netty-all-4.0.44.Final.jar:4.0.44.Final]
      	at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:302) [netty-all-4.0.44.Final.jar:4.0.44.Final]
      	at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) [netty-all-4.0.44.Final.jar:4.0.44.Final]
      	at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:144) [netty-all-4.0.44.Final.jar:4.0.44.Final]
      

      CASSANDRA-7849 addresses this for JAVA IO Exception like "java.io.IOException: Connection reset by peer", but not for Netty IOException since the exception message in Netty includes method name.

      Attachments

        Activity

          People

            sumanth.pasupuleti Sumanth Pasupuleti
            sumanth.pasupuleti Sumanth Pasupuleti
            Sumanth Pasupuleti
            Jason Brown
            Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: