Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-30151

Issue better error message when user-specified schema not match relation schema

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • SQL
    • None

    Description

      In DataSource.resolveRelation(), when relation schema does not match user-specified schema, it raises exception and says that "$className does not allow user-specified schemas."  However, it does allow user-specified schema if it matches relation schema. Instead, we should issue a better error message to tell user what is really happening here, e.g. clarify the mismatched fields to user.

      Attachments

        Issue Links

          Activity

            People

              Ngone51 wuyi
              Ngone51 wuyi
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: