[SPARK-29282] Use the same VM configurations for test/benchmark - ASF JIRA

Details

Type: Sub-task
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: 3.0.0
Fix Version/s: 3.0.0
Component/s: Tests
Labels:
None

Description

JDK11 versions are slower than JDK8.

#!/bin/bash

git clean -fdx
export JAVA_HOME=/Users/dongjoon/APACHE/jdk-release-adoptopenjdk/jdk8u222-b10/Contents/Home
SPARK_GENERATE_BENCHMARK_FILES=1 build/sbt "core/test:runMain org.apache.spark.serializer.KryoSerializerBenchmark"
cp core/benchmarks/KryoSerializerBenchmark-results.txt ~/KryoSerializerBenchmark-jdk8-results.txt

git clean -fdx
export JAVA_HOME=/Users/dongjoon/APACHE/jdk-release-adoptopenjdk/jdk-11.0.2+9/Contents/Home
SPARK_GENERATE_BENCHMARK_FILES=1 build/sbt "core/test:runMain org.apache.spark.serializer.KryoSerializerBenchmark"
cp core/benchmarks/KryoSerializerBenchmark-jdk11-results.txt ~/KryoSerializerBenchmark-jdk11.0.2-results.txt

git clean -fdx
export JAVA_HOME=/Users/dongjoon/APACHE/jdk-release-adoptopenjdk/jdk-11.0.3+7/Contents/Home
SPARK_GENERATE_BENCHMARK_FILES=1 build/sbt "core/test:runMain org.apache.spark.serializer.KryoSerializerBenchmark"
cp core/benchmarks/KryoSerializerBenchmark-jdk11-results.txt ~/KryoSerializerBenchmark-jdk11.0.3-results.txt

git clean -fdx
export JAVA_HOME=/Users/dongjoon/APACHE/jdk-release-adoptopenjdk/jdk-11.0.4+11/Contents/Home
SPARK_GENERATE_BENCHMARK_FILES=1 build/sbt "core/test:runMain org.apache.spark.serializer.KryoSerializerBenchmark"
cp core/benchmarks/KryoSerializerBenchmark-jdk11-results.txt ~/KryoSerializerBenchmark-jdk11.0.4-results.txt

================================================================================================
Benchmark KryoPool vs old"pool of 1" implementation
================================================================================================

OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Mac OS X 10.14.6
Intel(R) Core(TM) i9-8950HK CPU @ 2.90GHz
Benchmark KryoPool vs old"pool of 1" implementation:  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
KryoPool:true                                      2015           2647         710          0.0     4029936.9       1.0X
KryoPool:false                                     3526           4230         639          0.0     7052045.1       0.6X


================================================================================================
Benchmark KryoPool vs old"pool of 1" implementation
================================================================================================

OpenJDK 64-Bit Server VM 11.0.2+9 on Mac OS X 10.14.6
Intel(R) Core(TM) i9-8950HK CPU @ 2.90GHz
Benchmark KryoPool vs old"pool of 1" implementation:  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
KryoPool:true                                      2694           3402         955          0.0     5387690.7       1.0X
KryoPool:false                                     4050           4927         761          0.0     8099091.3       0.7X


================================================================================================
Benchmark KryoPool vs old"pool of 1" implementation
================================================================================================

OpenJDK 64-Bit Server VM 11.0.3+7 on Mac OS X 10.14.6
Intel(R) Core(TM) i9-8950HK CPU @ 2.90GHz
Benchmark KryoPool vs old"pool of 1" implementation:  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
KryoPool:true                                      2638           3482         NaN          0.0     5275226.1       1.0X
KryoPool:false                                     4165           4954         763          0.0     8329580.9       0.6X


================================================================================================
Benchmark KryoPool vs old"pool of 1" implementation
================================================================================================

OpenJDK 64-Bit Server VM 11.0.4+11 on Mac OS X 10.14.6
Intel(R) Core(TM) i9-8950HK CPU @ 2.90GHz
Benchmark KryoPool vs old"pool of 1" implementation:  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
KryoPool:true                                      2613           3523         NaN          0.0     5225510.3       1.0X
KryoPool:false                                     4037           4989         927          0.0     8074904.6       0.6X