Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-14220

Build and test Spark against Scala 2.12

    XMLWordPrintableJSON

Details

    Description

      This umbrella JIRA tracks the requirements for building and testing Spark against the current Scala 2.12 milestone.

      Attachments

        Issue Links

          is blocked by

          Wish - General wishlist item. SPARK-11416 Upgrade kryo package to version 3.0

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. SPARK-19810 Remove support for Scala 2.10

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          links to

          Pull request #19731 [Github] Pull Request #19731 (EmergentOrder)

          1.
          		 Cross-publish Chill for Scala 2.12 Sub-task Resolved Josh Rosen
          2.
          		 Cross-publish jackson-module-scala for Scala 2.12 Sub-task Resolved Josh Rosen
          3.
          		 Cross-publish Breeze for Scala 2.12 Sub-task Resolved Unassigned
          4.
          		 Cross-publish json4s-jackson for Scala 2.12 or remove json4s dependency Sub-task Resolved Unassigned
          5.
          		 Publish our forked genjavadoc for 2.12.0-M4 or stop using a forked version Sub-task Resolved Jakob Odersky
          6.
          		 Cross-publish Kafka for Scala 2.12 Sub-task Resolved Unassigned
          7.
          		 Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner Sub-task Resolved Stavros Kontopoulos
          8.
          		 Update change-version.sh and pom.xml to add Scala 2.12 profiles Sub-task Resolved Sean R. Owen
          9.
          		 Compile Spark REPL for Scala 2.12 Sub-task Resolved Sean R. Owen
          10.
          		 Update to scalatest 3.x Sub-task Resolved Unassigned
          11.
          		 Put Kafka 0.8 behind a profile Sub-task Resolved Sean R. Owen
          12.
          		 Clear remaining compile errors for 2.12; resolve most warnings Sub-task Resolved Sean R. Owen
          13.
          		 Update paranamer to 2.8 to avoid BytecodeReadingParanamer ArrayIndexOutOfBoundsException with Scala 2.12 + Java 8 lambda Sub-task Resolved Sean R. Owen
          14.
          		 Update FutureAction for compatibility with Scala 2.12 future Sub-task Resolved Sean R. Owen
          15.
          		 Address translation of LMF closure primitive args to Object in Scala 2.12 Sub-task Resolved Sean R. Owen
          16.
          		 Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel Sub-task Resolved Sean R. Owen
          17.
          		 Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors Sub-task Resolved Sean R. Owen
          18.
          		 Plan mismatch errors in Hive tests in 2.12 Sub-task Resolved Darcy Shen
          19.
          		 Future for Scala 2.12 will block on a already shutdown ExecutionContext Sub-task Resolved Unassigned
          20.
          		 spark-tools build failure for Scala 2.12 Sub-task Resolved Darcy Shen
          21.
          		 enable HiveSparkSubmitSuite SPARK-8489 test for Scala 2.12 Sub-task Resolved Darcy Shen
          22.
          		 HiveExternalCatalogVersionsSuite + Scala 2.12 = NoSuchMethodError: org.apache.spark.sql.execution.datasources.FileFormat.$init$(Lorg/apache/spark/sql/execution/datasources/FileFormat;) Sub-task Resolved Dongjoon Hyun

          Activity

            People

              srowen Sean R. Owen
              joshrosen Josh Rosen
              Votes:
              77 Vote for this issue
              Watchers:
              102 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: