Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-23400

Add the extra constructors for ScalaUDF

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.0
    • 2.3.0
    • SQL
    • None

    Description

      The last few releases, we changed the interface of ScalaUDF. Unfortunately, some Spark Package (spark-deep-learning) are using our internal class `ScalaUDF`. In the release 2.3, we added new parameters into these class. The users hit the binary compatibility issues and got the exception:

      > java.lang.NoSuchMethodError: org.apache.spark.sql.catalyst.expressions.ScalaUDF.<init>(Ljava/lang/Object;Lorg/apache/spark/sql/types/DataType;Lscala/collection/Seq;Lscala/collection/Seq;Lscala/Option;)V

      Attachments

        Activity

          People

            smilegator Xiao Li
            smilegator Xiao Li
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: