Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-24417

Build and Run Spark on JDK11

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Done
    • 2.3.0
    • 3.0.0
    • Build
    • None

    Description

      This is an umbrella JIRA for Apache Spark to support JDK11

      As JDK8 is reaching EOL, and JDK9 and 10 are already end of life, per community discussion, we will skip JDK9 and 10 to support JDK 11 directly.

      Attachments

        Issue Links

          contains

          Bug - A problem which impairs or prevents the functions of the product. SPARK-33999 Make sbt unidoc success with JDK11

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. SPARK-24475 Nested JSON count() Exception

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-27537 spark-2.4.1/mlib-local/src/test/scala/org/apache/spark/ml/linalg/MatricesSuite.scala.866:Value size is not a member of Object

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-27538 sparksql could not start in jdk11, exception org.datanucleus.exceptions.NucleusException: The java type java.lang.Long (jdbc-type='', sql-type="") cant be mapped for this datastore. No mapping is available.

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-31531 sun.misc.Cleaner sun.nio.ch.DirectBuffer.cleaner() method not found during spark-submit

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-25820 Spark build fails with Java 9

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue SPARK-29173 Benchmark JDK 11 performance with FilterPushdownBenchmark

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-26427 Upgrade Apache ORC to 1.5.4

          • Major - Major loss of function.
          • Resolved

          Umbrella - An overarching type made of sub-tasks SPARK-29194 JDK11 QA

          • Major - Major loss of function.
          • Resolved
          is required by

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-28596 Use Java 8 time API in date_trunc

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-15338 Java 11 runtime support

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. KAFKA-7264 Initial Kafka support for Java 11

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. PARQUET-1590 [parquet-format] Add Java 11 to Travis

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-10848 Cleanup calling of sun.security.krb5.Config

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Umbrella - An overarching type made of sub-tasks SPARK-28684 Hive module support JDK 11

          • Major - Major loss of function.
          • Resolved

          Dependency upgrade - Upgrading a dependency to a newer version SPARK-25757 Upgrade netty-all from 4.1.17.Final to 4.1.30.Final

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          There are no Sub-Tasks for this issue.

          Activity

            People

              dbtsai DB Tsai
              dbtsai DB Tsai
              Votes:
              28 Vote for this issue
              Watchers:
              61 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: