Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-34831

spark2.3 can't add column in carbondata table

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Not A Problem
    • 3.1.0
    • None
    • Spark Shell
    • None
    • spark2.3   carbondata1.5.3    cdh5.16

    Description

      when i want to add an column in carbondata table with spark2.3, but it occur a error,here it's the detail of mistake:

      // ALTER ADD COLUMNS does not support datasource table with type org.apache.spark.sql.CarbonSource
        at org.apache.spark.sql.execution.command.AlterTableAddColumnsCommand.verifyAlterTableAddColumn(tables.scala:242)
        at org.apache.spark.sql.execution.command.AlterTableAddColumnsCommand.run(tables.scala:194)
        at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:70)
        at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:68)
        at org.apache.spark.sql.execution.command.ExecutedCommandExec.executeCollect(commands.scala:79)
        at org.apache.spark.sql.Dataset$$anonfun$6.apply(Dataset.scala:190)
        at org.apache.spark.sql.Dataset$$anonfun$6.apply(Dataset.scala:190)
        at org.apache.spark.sql.Dataset$$anonfun$52.apply(Dataset.scala:3259)
        at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:77)
        at org.apache.spark.sql.Dataset.withAction(Dataset.scala:3258)
        at org.apache.spark.sql.Dataset.<init>(Dataset.scala:190)
        at org.apache.spark.sql.Dataset$.ofRows(Dataset.scala:75)
        at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:642)
      

      so,i wish it can be supported in latest version.Thanks

      Attachments

        Activity

          People

            Unassigned Unassigned
            zptang Carefree
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: