Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
0.6.0
-
None
-
HDP 2.5
Apache ZeppelinVersion 0.6.0.2.5.0.0-1245
Description
When using %livy.spark
if you have new line and comments in multi-line statement it breaks. Same code using regular spark statement works correct.
Error that you get:
<console>:1: error: illegal start of definition
.format("com.databricks.spark.csv")
Example:
%livy.spark
val df = sqlContext.read
.format("com.databricks.spark.csv")
.option("header", "true") // Use first line of all files as header
.option("inferSchema", "true") // Automatically infer data types
.load("/tmp/airflightsdelays/") // Read all flights
df.printSchema
If i consolidate the code it works fine:
%livy.spark
val df = sqlContext.read.format("com.databricks.spark.csv").option("header", "true").option("inferSchema", "true").load("/tmp/airflightsdelays/") // Read all flights
Attachments
Attachments
Issue Links
- relates to
-
ZEPPELIN-3547 Spark scala line breaks not working (illegal start of definition)
- Closed