Details
-
Bug
-
Status: Resolved
-
Minor
-
Resolution: Invalid
-
2.4.3
-
None
-
None
Description
scala> sc.parallelize(Seq(1, 2, 3)).mapPartitions(xs => xs.map(2*).zip(xs)).collect.foreach(println) ... java.util.NoSuchElementException: next on empty iterator
Workaround - implement zip with mapping to tuple:
scala> sc.parallelize(Seq(1, 2, 3)).mapPartitions(xs => xs.map(x => (x * 2, x))).collect.foreach(println) (2,1) (4,2) (6,3)