Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-14220 Build and test Spark against Scala 2.12
  3. SPARK-22087

Clear remaining compile errors for 2.12; resolve most warnings

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.3.0
    • 2.3.0
    • Build, Spark Core
    • None

    Description

      In the course of finishing SPARK-14650 I found there are still some compile problems and tens of avoidable warnings in 2.12 that can be fixed without, it seems, impacting the 2.11 build. There's enough work that I made a separate JIRA for it here.

      It generally includes:

      • Selecting Kafka 0.10.1+ for Scala 2.12 and patching over a minor API difference
      • Fixing lots of "eta expansion of zero arg method deprecated" warnings
      • Resolving the SparkContext.sequenceFile implicits compile problem
      • Fixing an odd but valid jetty-server missing dependency in hive-thriftserver

      Attachments

        Activity

          People

            srowen Sean R. Owen
            srowen Sean R. Owen
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: