Details
-
Question
-
Status: Resolved
-
Minor
-
Resolution: Invalid
-
3.1.2
-
None
-
None
Description
Spark documentation mentions this:
https://spark.apache.org/docs/3.0.0/security.html
spark.network.crypto.config.*
"Configuration values for the commons-crypto library, such as which cipher implementations to use. The config name should be the name of commons-crypto configuration without the commons.crypto prefix."
What this means?
If I leave it to None what will happen? There won't be any encryption used or will it fallback to some default one?
The common-crypto mentions that it uses JCE or OPENSSL implementations, but says nothing about the ciphers.
Does it support everything the given JVM does?
The documentation is vague on this.
However the spark ui part for the security is clear:
${ns}.enabledAlgorithms
A comma-separated list of ciphers. The specified ciphers must be supported by JVM. The reference list of protocols can be found in the "JSSE Cipher Suite Names" section of the Java security guide. The list for Java 8 can be found at this page. Note: If not set, the default cipher suite for the JRE will be used.
So what will happen if I leave spark.network.crypto.config.* to None?
And what ciphers are supported?