Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
3.2.0
-
None
-
None
Description
In https://github.com/apache/spark/pull/32955, the lit function defined in pyspark.pandas.spark.functions has been adjusted to support numpy literals input.
However, the mapping between numpy literals and Spark data types is not complete.
We ought to fill the gap.
Attachments
Issue Links
- relates to
-
SPARK-34849 SPIP: Support pandas API layer on PySpark
- Resolved