Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-7100

GradientBoostTrees leaks a persisted RDD

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.2.2, 1.3.1
    • 1.4.0
    • MLlib
    • None

    Description

      It appears GradientBoostedTrees.scala can call 'persist' on an RDD and never unpersist it.

      In the master branch it's in GradientBoostedTrees.boost method. It "persists" the input RDD if it's not already persisted but doesn't unpersist it.

      I'll be submitting a PR with a fix.

      Attachments

        Activity

          People

            jimfcarroll Jim Carroll
            jimfcarroll Jim Carroll
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: