Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-4692

zeppelin pyspark doesn't print java output

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.8.2
    • 0.9.0
    • pySpark, spark
    • None
    • Env:

      Zeppelin: 0.8.2

      Spark 2.4.4

      Scala: 2.11.7

      Python 3.7.2

       

    Description

       

      Problem description:

      i created a custom jar file my-test-1.0-SNAPSHOT.jar with following java code:

      package com.mycompany.app; 
       import java.util.LinkedList; import java.util.List; 
       public class Stack { 
           public void my_open() {         System.out.println("calling open file");     } 
           public void my_close() {         System.out.println("calling close file");     } 
       }

       
      when i use pyspark shell, it works well.
      pyspark --driver-class-path my-test-1.0-SNAPSHOT.jar

       
      but when i use pyspark in Zeppelin, it works only for the first time, with proper output "calling open file". But after then, as following shows the method 'my_open' failed to execute with 'None' returned.

       
      more actions:
      1. when i tried to use Scala in Zeppelin to do the same, it worked well.

       
        2. i restarted the spark interpreter, then it worked again for the first time, and further running failed.
       
       

      Attachments

        1. image-2020-03-23-18-04-59-789.png
          6 kB
          Shuai Ma
        2. image-2020-03-23-17-57-22-868.png
          3 kB
          Shuai Ma
        3. image-2020-03-23-17-51-39-226.png
          11 kB
          Shuai Ma

        Issue Links

          Activity

            People

              zjffdu Jeff Zhang
              mashuai_191 Shuai Ma
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1.5h
                  1.5h