Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-26670

worker.py uses resource python library, which is not available for windows

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 2.4.0
    • None
    • PySpark
    • None

    Description

      worker.py in spark 2.4.0 uses the resource python library, which is only available for unix.

       

      I'm trying out to run sample code for pyspark on Windows. It fails with an import error in worker.py for "resource". Thus, the sample code does not work on windows with spark 2.4.0. However, the same code works with spark 2.3.2 (which lacks the "resource" dependency).

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              rbuffat René Buffat
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: