Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-4591 Algorithm/model parity for spark.ml (Scala)
  3. SPARK-13857

Feature parity for ALS ML with MLLIB

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • None
    • None
    • ML
    • None

    Description

      Currently mllib.recommendation.MatrixFactorizationModel has methods recommendProducts/recommendUsers for recommending top K to a given user / item, as well as recommendProductsForUsers/recommendUsersForProducts to recommend top K across all users/items.

      Additionally, SPARK-10802 is for adding the ability to do recommendProductsForUsers for a subset of users (or vice versa).

      Look at exposing or porting (as appropriate) these methods to ALS in ML.

      Investigate if efficiency can be improved at the same time (see SPARK-11968).

      Attachments

        Issue Links

          is duplicated by

          Sub-task - The sub-task of the issue SPARK-14379 Review spark.ml parity for recommendation

          • Major - Major loss of function.
          • Closed
          is related to

          New Feature - A new feature of the product, which has yet to be developed. SPARK-19535 ALSModel recommendAll analogs

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-14412 spark.ml ALS prefered storage level Params

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-11968 ALS recommend all methods spend most of time in GC

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-18235 ml.ALSModel function parity: ALSModel should support recommendforAll

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-10802 Let ALS recommend for subset of data

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. SPARK-14489 RegressionEvaluator returns NaN for ALS in Spark ml

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-14409 Investigate adding a RankingEvaluator to ML

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Pull request #12574 [Github] Pull Request #12574 (MLnick)

          Activity

            People

              mlnick Nicholas Pentreath
              mlnick Nicholas Pentreath
              Votes:
              2 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: