Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-2680

Lower spark.shuffle.memoryFraction to 0.2 by default

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 1.1.0
    • Shuffle, Spark Core
    • None

    Description

      Seems like it's good to be more conservative on this, in particular to try to fit all the data in the young gen. People can always increase it for performance.

      Attachments

        Activity

          People

            matei Matei Alexandru Zaharia
            matei Matei Alexandru Zaharia
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: