[SPARK-6878] Sum on empty RDD fails with exception - ASF JIRA

XML

Word

Printable

JSON

Sum on an empty RDD throws an exception. Expected result is 0.

A simple fix is the replace

class DoubleRDDFunctions {
  def sum(): Double = self.reduce(_ + _)

with:

class DoubleRDDFunctions {
  def sum(): Double = self.aggregate(0.0)(_ + _, _ + _)

is related to

SPARK-8373 When an RDD has no partition, Python sum will throw "Can not reduce() empty RDD"

links to

[Github] Pull Request #5489 (erikvanoosten)