Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-2692

pyspark die on second run error

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.7.1
    • None
    • None
    • mac, spark 2.1.1

    Description

      I ran pyspark code the first time it was fine, the second time it dies and show this on every single cell of my zeppelin notebook, and also other notebook that I am running with pyspark, I have to turn on Zeppelin code and restart in order to fix this.

      Traceback (most recent call last):
      File "/var/folders/zh/dvdnf74d1t9cq78hjjm3xft80000gn/T/zeppelin_pyspark-1462033700144752464.py", line 343, in <module>
      sc.setJobGroup(jobGroup, "Zeppelin")
      File "/Users/titusfong/spark/python/pyspark/context.py", line 902, in setJobGroup
      self._jsc.setJobGroup(groupId, description, interruptOnCancel)
      AttributeError: 'NoneType' object has no attribute 'setJobGroup'

      this error should be similar to this issue which I don't think is solved yet:
      http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/Error-about-PySpark-td4988.html
      https://issues.apache.org/jira/browse/ZEPPELIN-2449?jql=project%20%3D%20ZEPPELIN%20AND%20text%20~%20%22sc.setJobGroup%22

      Attachments

        Activity

          People

            Unassigned Unassigned
            titusfong TitusFong
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: