Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-4088

spark interpreter always writing to /tmp file system

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • 0.8.0
    • None
    • Interpreters
    • None
    • zeppelin 0.8.0

      spark 2.1.0

    Description

      spark interpreter always writing to  /tmp file system, create a sparkXXXX directory, Space used  keeps increasing after every %spark interpreter  execute.

      I had config  spark.local.dir = [other path]  in interpreter configuration  or add SPARK_SUBMIT_OPTIONS in zeppelin-env.sh, but no effect.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            itpudge EasonZheng

            Dates

              Created:
              Updated:

              Slack

                Issue deployment