Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-1267

PySparkInterpreter doesn't work in spark 2.0

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.7.0
    • 0.6.1, 0.7.0
    • Interpreters
    • None

    Description

      py4j and pyspark.zip is not distributed to executors. 

      Error from python worker:
  /usr/bin/python: No module named pyspark
PYTHONPATH was:
  /Users/jzhang/Temp/hadoop_tmp/nm-local-dir/usercache/jzhang/filecache/27/__spark_libs__3944184934921201174.zip/spark-core_2.11-2.0.0.jar

      Attachments

        Issue Links

          blocks

          Task - A task that needs to be done. ZEPPELIN-1177 Release 0.6.1

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #1260

          Activity

            People

              zjffdu Jeff Zhang
              zjffdu Jeff Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: