Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-26924

Fix CRAN hack as soon as Arrow is available on CRAN

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 3.0.0
    • None
    • SparkR, SQL
    • None

    Description

      Arrow optimization was added but Arrow is not available on CRAN.

      So, it had to add some hacks to avoid CRAN check in SparkR side. For example, see

      https://github.com/apache/spark/search?q=requireNamespace1&unscoped_q=requireNamespace1

      These should be removed to properly check CRAN in SparkR

      See also ARROW-3204

      Attachments

        Issue Links

          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-29339 Support Arrow 0.14 in vectoried dapply and gapply (test it in AppVeyor build)

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              gurwls223 Hyukjin Kwon
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: