Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-29194 JDK11 QA
  3. SPARK-29173

Benchmark JDK 11 performance with FilterPushdownBenchmark

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • Build
    • None

    Description

      I was comparing the performance of JDK 8 and JDK 11 using FilterPushdownBenchmark:

      bin/spark-submit --master local[1] --conf "spark.driver.extraJavaOptions=-XX:+UseG1GC --driver-memory 20G --class org.apache.spark.sql.execution.benchmark.FilterPushdownBenchmark  jars/spark-sql_2.12-3.0.0-SNAPSHOT-tests.jar

      It seems JDK 11 is slower than JDK 8.

      Attachments

        1. jdk8.txt
          86 kB
          Yuming Wang
        2. jdk11.txt
          86 kB
          Yuming Wang

        Issue Links

          is related to

          Sub-task - The sub-task of the issue SPARK-29282 Use the same VM configurations for test/benchmark

          • Major - Major loss of function.
          • Resolved
          relates to

          New Feature - A new feature of the product, which has yet to be developed. SPARK-24417 Build and Run Spark on JDK11

          • Major - Major loss of function.
          • Resolved
          links to

          Pull request #27078 [Github] Pull Request #27078 (MaxGekk)

          Activity

            People

              maxgekk Max Gekk
              yumwang Yuming Wang
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: