Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-30165 Eliminate compilation warnings
  3. SPARK-30520

Eliminate deprecation warnings for UserDefinedAggregateFunction

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.0.0
    • None
    • SQL
    • None

    Description

      /Users/maxim/proj/eliminate-expr-info-warnings/sql/core/src/main/scala/org/apache/spark/sql/UDFRegistration.scala
          Warning:Warning:line (718)class UserDefinedAggregateFunction in package expressions is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
            val udaf = clazz.getConstructor().newInstance().asInstanceOf[UserDefinedAggregateFunction]
          Warning:Warning:line (719)method register in class UDFRegistration is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
            register(name, udaf)
      /Users/maxim/proj/eliminate-expr-info-warnings/sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/udaf.scala
          Warning:Warning:line (328)class UserDefinedAggregateFunction in package expressions is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
          udaf: UserDefinedAggregateFunction,
          Warning:Warning:line (326)class UserDefinedAggregateFunction in package expressions is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
      case class ScalaUDAF(
      /Users/maxim/proj/eliminate-expr-info-warnings/sql/core/src/test/scala/org/apache/spark/sql/DataFrameWindowFunctionsSuite.scala
          Warning:Warning:line (363)class UserDefinedAggregateFunction in package expressions is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
          val udaf = new UserDefinedAggregateFunction {
      /Users/maxim/proj/eliminate-expr-info-warnings/sql/core/src/test/java/test/org/apache/spark/sql/MyDoubleSum.java
          Warning:Warning:line (25)java: org.apache.spark.sql.expressions.UserDefinedAggregateFunction in org.apache.spark.sql.expressions has been deprecated
          Warning:Warning:line (35)java: org.apache.spark.sql.expressions.UserDefinedAggregateFunction in org.apache.spark.sql.expressions has been deprecated
      /Users/maxim/proj/eliminate-expr-info-warnings/sql/core/src/test/java/test/org/apache/spark/sql/MyDoubleAvg.java
          Warning:Warning:line (25)java: org.apache.spark.sql.expressions.UserDefinedAggregateFunction in org.apache.spark.sql.expressions has been deprecated
          Warning:Warning:line (36)java: org.apache.spark.sql.expressions.UserDefinedAggregateFunction in org.apache.spark.sql.expressions has been deprecated
      /Users/maxim/proj/eliminate-expr-info-warnings/sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/AggregationQuerySuite.scala
          Warning:Warning:line (36)class UserDefinedAggregateFunction in package expressions is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
      class ScalaAggregateFunction(schema: StructType) extends UserDefinedAggregateFunction {
          Warning:Warning:line (73)class UserDefinedAggregateFunction in package expressions is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
      class ScalaAggregateFunctionWithoutInputSchema extends UserDefinedAggregateFunction {
          Warning:Warning:line (100)class UserDefinedAggregateFunction in package expressions is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
      class LongProductSum extends UserDefinedAggregateFunction {
          Warning:Warning:line (189)method register in class UDFRegistration is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
          spark.udf.register("mydoublesum", new MyDoubleSum)
          Warning:Warning:line (190)method register in class UDFRegistration is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
          spark.udf.register("mydoubleavg", new MyDoubleAvg)
          Warning:Warning:line (191)method register in class UDFRegistration is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
          spark.udf.register("longProductSum", new LongProductSum)
          Warning:Warning:line (943)method register in class UDFRegistration is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
            spark.udf.register("noInputSchema", new ScalaAggregateFunctionWithoutInputSchema)
      /Users/maxim/proj/eliminate-expr-info-warnings/sql/hive/src/test/java/org/apache/spark/sql/hive/JavaDataFrameSuite.java
          Warning:Warning:line (30)java: org.apache.spark.sql.expressions.UserDefinedAggregateFunction in org.apache.spark.sql.expressions has been deprecated
          Warning:Warning:line (78)java: org.apache.spark.sql.expressions.UserDefinedAggregateFunction in org.apache.spark.sql.expressions has been deprecated
          Warning:Warning:line (79)java: org.apache.spark.sql.expressions.UserDefinedAggregateFunction in org.apache.spark.sql.expressions has been deprecated
          Warning:Warning:line (79)java: register(java.lang.String,org.apache.spark.sql.expressions.UserDefinedAggregateFunction) in org.apache.spark.sql.UDFRegistration has been deprecated
      

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              maxgekk Max Gekk
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: