Details
Description
Previous PR: https://github.com/apache/spark/blob/master/python/pyspark/ml/functions.py
In the previous PR, we introduced a UDF to convert a column of MLlib Vecters to a column of lists in python (Seq in scala). Currently, all the floating numbers in a vector is converted to Double in scala. In this issue, we will add a parameter in the python function vector_to_array(col) that allows converting to Float (32bits) in scala, which would be mapped to a numpy array of dtype=float32.
Attachments
Issue Links
- links to