Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-27884 Deprecate Python 2 and Python 3 prior to 3.6 support in Spark 3.0
  3. SPARK-29672

update spark testing framework to use python3

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • Build
    • None

    Description

      python 2.7 is EOL jan 1st 2020: https://github.com/python/devguide/pull/344

      it's time, at least for 3.0+ to migrate the test execution framework to python 3.6.

      this PR (https://github.com/apache/spark/pull/26330) does all of the above.

      after 3.0 is cut, we can then add python3.8 and drop python2.7 and pypy2.5.1 test support.

      Attachments

        Activity

          People

            shaneknapp Shane Knapp
            shaneknapp Shane Knapp
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: