Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-7195

Can't start spark shell or pyspark in Windows 7

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 1.3.1
    • None
    • PySpark, Spark Shell
    • None
    • Windows 7, Java 8 (1.8.0_31) or Java 7 (1.7.0_79), Scala 2.11.6, Python 2.7

    • Important

    Description

      cd\spark\bin dir
      spark-shell
      yields following error:
      find: 'version': No such file or directory
      else was unexpected at this time

      Same error with
      spark-shell2.cmd

      PyShell starts but with errors and doesn't work properly once started
      (e.g., can't find sc). Can send screenshot of errors on request.

      Using Spark 1.3.1 for Hadoop 2.6 binary
      Note: Hadoop not installed on machine.
      Scala works by itself, Python works by itself
      Java works fine (I use it all the time)

      Based on another comment, tried Java 7 (1.7.0_79), but it made no difference (same error).

      JAVA_HOME = C:\jdk1.8.0\bin
      C:\jdk1.8.0\bin\;C:\Program Files (x86)\scala\bin;C:\Python27;c:\Rtools\bin;c:\Rtools\gcc-4.6.3\bin;C:\Oracle\product64\12.1.0\client_1\bin;C:\Oracle\product\12.1.0\client_1\bin;C:\ProgramData\Oracle\Java\javapath;C:\Program Files (x86)\Intel\iCLS Client\;C:\Program Files\Intel\iCLS Client\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files\Intel\Intel(R) Management Engine Components\DAL;C:\Program Files\Intel\Intel(R) Management Engine Components\IPT;C:\Program Files (x86)\Intel\Intel(R) Management Engine Components\DAL;C:\Program Files (x86)\Intel\Intel(R) Management Engine Components\IPT;C:\Program Files\Dell\Dell Data Protection\Access\Advanced\Wave\Gemalto\Access Client\v5\;C:\Program Files (x86)\NTRU Cryptosystems\NTRU TCG Software Stack\bin\;C:\Program Files\NTRU Cryptosystems\NTRU TCG Software Stack\bin\;C:\Program Files (x86)\Intel\OpenCL SDK\2.0\bin\x86;C:\Program Files (x86)\Intel\OpenCL SDK\2.0\bin\x64;C:\Program Files\MiKTeX 2.9\miktex\bin\x64\;C:\Program Files (x86)\ActivIdentity\ActivClient\;C:\Program Files\ActivIdentity\ActivClient\

      Attachments

        1. spark_bug.png
          63 kB
          Mark Smiley

        Issue Links

          Activity

            People

              Unassigned Unassigned
              DrFractal Mark Smiley
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: