Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-5644

Reduce redundancy during the interpreter execution process

Agile BoardAttach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.10.0
    • 0.11.0
    • Interpreters
    • None

    Description

      Hi, I found some issues when trying to investigate the spark OOM issue:

      1. Thread of interpreter executor hasn't been closed when interpreter is restarted;
      2. When restart from notebook page, the Zeppelin Daemon are going to close all interpreters, while Zeppelin interpreter server only close the opened interpreters indeed, and it causes in duplicated interpreters kept in server side;
      3. After one user starts multi spark sessions, duplicated loaded Classes are founded for the innerScalaInterpreter inside the spark interpreter, since the threads are created in different sub threads, and they don't share loaded class.

      I will create a PR to solve the above issues.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            suns Sun Shun
            suns Sun Shun
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - Not Specified
              Not Specified
              Remaining:
              Remaining Estimate - 0h
              0h
              Logged:
              Time Spent - 3h 50m
              3h 50m

              Slack

                Issue deployment