Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-4088

spark interpreter always writing to /tmp file system

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • 0.8.0
    • None
    • Interpreters
    • None
    • zeppelin 0.8.0

      spark 2.1.0

    Description

      spark interpreter always writing to  /tmp file system, create a sparkXXXX directory, Space used  keeps increasing after every %spark interpreter  execute.

      I had config  spark.local.dir = [other path]  in interpreter configuration  or add SPARK_SUBMIT_OPTIONS in zeppelin-env.sh, but no effect.

      Attachments

        1. abc.png
          43 kB
          EasonZheng
        2. E93AE74C-6BFB-4862-BAA5-A1459A41157E.png
          1 kB
          EasonZheng

        Activity

          People

            Unassigned Unassigned
            itpudge EasonZheng
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: