Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-29121

Support Dot Product for Vectors

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.5, 2.4.5, 3.0.0
    • 3.0.0
    • ML, MLlib
    • None

    Description

      I believe org.apache.spark.ml.linalg.Vectors and org.apache.spark.mllib.linalg.Vectors should support the dot product. The necessary BLAS routines are already there, just a simple wrapper is needed.

      I know there has been a lot of discussion about how much of a linear algebra package should spark attempt to be, but I have found that the dot product comes up quite a bit for feature engineering and scoring. In the past we have created our own org.apache.spark.ml.linalg package to expose the private methods, but it's an annoying hack.

      See also:

      SPARK-6442
      SPARK-10989

      Attachments

        Issue Links

          Activity

            People

              phpisciuneri Patrick Pisciuneri
              phpisciuneri Patrick Pisciuneri
              Sean R. Owen Sean R. Owen
              Votes:
              1 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: