Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-5914

Enable spark-submit to run requiring only user permission on windows

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 1.4.0
    • Spark Submit, Windows
    • None
    • Windows

    Description

      On windows platform only.

      If slave is executed with user permission, spark-submit fails with java.lang.ClassNotFoundException when attempting to read the cached jar from spark_home\work folder.

      This is due to the jars do not have read permission set by default on windows. Fix is to add read permission explicitly for owner of the file.

      Having service account running as admin (equivalent of sudo in Linux) is a major security risk for production clusters. This make it easy for hackers to compromise the cluster by taking over the service account.

      Attachments

        Activity

          People

            judynash Judy Nash
            judynash Judy Nash
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: