Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-443

Should verify matching Spark versions at launch

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.5.6
    • None
    • Core, Interpreters

    Description

      Zeppelin or the SparkInterpreter should, at launch, check to confirm that the current SPARK_HOME matches the same version of Spark that was used when Zeppelin was built.

      If Zeppelin is run with a different Spark version in SPARK_HOME than was used when Zeppelin was built, attempting to start spark from the SparkInterpreter is likely to fail with an exception. But the exception varies depending on the particular version-mismatch (class not found, method not found, inconsistent dependency library versions, etc.), and none of the error messages are helpful.

      The correct behavior is to detect this and fail early – or at least report it properly.

      Attachments

        Activity

          People

            Unassigned Unassigned
            amoselb Amos
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated: