Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-16458

SessionCatalog should support `listColumns` for temporary tables

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 2.0.0
    • SQL
    • None

    Description

      Temporary tables are used frequently, but `spark.catalog.listColumns` does not support those tables.

      scala> spark.range(10).createOrReplaceTempView("t1")

scala> spark.catalog.listTables().collect()
res1: Array[org.apache.spark.sql.catalog.Table] = Array(Table[name='t1', tableType='TEMPORARY', isTemporary='true'])

scala> spark.catalog.listColumns("t1").collect()
org.apache.spark.sql.AnalysisException: Table 't1' does not exist in database 'default'.;

      This issue make `SessionCatalog` supports temporary table column listing.

      Attachments

        Issue Links

          relates to

          New Feature - A new feature of the product, which has yet to be developed. SPARK-16452 basic INFORMATION_SCHEMA support

          • Major - Major loss of function.
          • Resolved
          links to

          Pull request #14114 [Github] Pull Request #14114 (dongjoon-hyun)

          Activity

            People

              dongjoon Dongjoon Hyun
              dongjoon Dongjoon Hyun
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: