Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-4414

Upgrade thrift to 0.13

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.9.0
    • 0.9.0
    • Interpreters
    • None

    Description

      When i restart spark interpreter from ui it crashes entire zeppelin and causes this exception:

      INFO  ({pool-4-thread-1} ManagedInterpreterGroup.java[close]:105) - Kill RemoteInterpreterProcess

      INFO [ ({pool-4-thread-1} RemoteInterpreterManagedProcess.java[stop]:131) - Kill interpreter process

      ERROR  ({pool-6-thread-5} TThreadPoolServer.java[run]:315) - Thrift error occurred during processing of message.

      org.apache.thrift.transport.TTransportException

      at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)

      at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)

      at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:425)

      at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:321)

      at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:225)

      at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:27)

      at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:310)

      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

      at java.lang.Thread.run(Thread.java:748)

      WARN ({pool-4-thread-1} RemoteInterpreterManagedProcess.java[stop]:141) - ignore the exception when shutting down

      java.lang.RuntimeException: org.apache.thrift.transport.TTransportException

      at org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.callRemoteFunction(RemoteInterpreterProcess.java:122)

      at org.apache.zeppelin.interpreter.remote.RemoteInterpreterManagedProcess.stop(RemoteInterpreterManagedProcess.java:133)

      at org.apache.zeppelin.interpreter.ManagedInterpreterGroup.close(ManagedInterpreterGroup.java:106)

      at org.apache.zeppelin.interpreter.ManagedInterpreterGroup.close(ManagedInterpreterGroup.java:88)

      at org.apache.zeppelin.interpreter.lifecycle.TimeoutLifecycleManager.lambda$new$0(TimeoutLifecycleManager.java:51)

      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

      at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)

      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)

      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)

      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

      at java.lang.Thread.run(Thread.java:748)

      Caused by: org.apache.thrift.transport.TTransportException

      at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)

      at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)

      at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:425)

      at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:321)

      at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:225)

      at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)

      at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_shutdown(RemoteInterpreterService.java:347)

      at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.shutdown(RemoteInterpreterService.java:335)

      at org.apache.zeppelin.interpreter.remote.RemoteInterpreterManagedProcess$1.call(RemoteInterpreterManagedProcess.java:136)

      at org.apache.zeppelin.interpreter.remote.RemoteInterpreterManagedProcess$1.call(RemoteInterpreterManagedProcess.java:133)

      at org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.callRemoteFunction(RemoteInterpreterProcess.java:118)

      ... 11 more

       

      Upgrading thrift to 0.13 might fix this issue since 0.12.0 had a major bug which could be related to Transport Exception we're seeing in Zeppelin. We've upgraded to thrift 0.13 and haven't been able to re-produce the same issue yet.  https://issues.apache.org/jira/browse/THRIFT-4858

      Attachments

        Issue Links

          Activity

            People

              zjffdu Jeff Zhang
              amandeep.kaur Amandeep
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m