Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-25334

Default SessionCatalog should support UDFs

    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • 2.3.1
    • None
    • SQL

    Description

      SessionCatalog calls registerFunction to add a function to function registry. However, makeFunctionExpression supports only UserDefinedAggregateFunction.

      We should make makeFunctionExpression support UserDefinedFunction, as it's one of functions type.

      Currently we can use persistent functions only with Hive metastore, but "create function" command works also with default SessionCatalog. It sometimes cause user confusion, like in https://stackoverflow.com/questions/52164488/spark-hive-udf-no-handler-for-udaf-analysis-exception/52170519

      Attachments

        Activity

          People

            Unassigned Unassigned
            TomaszGaweda Tomasz Gawęda
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: