Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-31701

Bump up the minimum Arrow version as 0.15.1 in SparkR

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • SparkR, SQL
    • None

    Description

      PySpark side bumped up the minimum Arrow version at SPARK-29376. We should better bump up the version in SparkR side to match with 0.15.1. There's no backward compatibility concern because Arrow optimization in SparkR is new.

      Attachments

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-29378 Upgrade SparkR to use Arrow 0.15 API

          • Major - Major loss of function.
          • Resolved
          links to

          Pull request #28520 [Github] Pull Request #28520 (HyukjinKwon)

          Activity

            People

              gurwls223 Hyukjin Kwon
              gurwls223 Hyukjin Kwon
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: