Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-30339

Avoid to fail twice in function lookup

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.4.5, 3.0.0
    • 2.4.5, 3.0.0
    • SQL
    • None

    Description

      Currently if function lookup fails, spark will give it a second chance by casting decimal type to double type. But for cases where decimal type doesn't exist, it's meaningless to lookup again and cause extra cost like unnecessary metastore access. We should throw exceptions directly in these cases.

      Attachments

        Activity

          People

            zhenhuawang Zhenhua Wang
            zhenhuawang Zhenhua Wang
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: