Details
-
Sub-task
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
3.0.0
-
The deprecated method SparkConf.setAll(Traversable) has been removed in Spark 3.1. Use SparkConf.setAll(Iterable) instead.
Description
SparkConf has the following overloads, which were also driven by Scala version compatibility:
/** Set multiple parameters together */ def setAll(settings: Iterable[(String, String)]): SparkConf = { settings.foreach { case (k, v) => set(k, v) } this } /** * Set multiple parameters together */ @deprecated("Use setAll(Iterable) instead", "3.0.0") def setAll(settings: Traversable[(String, String)]): SparkConf = { settings.foreach { case (k, v) => set(k, v) } this }
However this becomes ambiguous in Scala 2.13. We'll just have to remove the second one.