Description
scala> spark.range(10).selectExpr("array()").printSchema() root |-- array(): array (nullable = false) | |-- element: null (containsNull = false) scala> spark.range(10).selectExpr("concat(array()) as arr").printSchema() root |-- arr: array (nullable = false) | |-- element: null (containsNull = false) scala> spark.range(10).selectExpr("concat(array(), array(1)) as arr").printSchema() root |-- arr: array (nullable = false) | |-- element: integer (containsNull = true)
The last case should not coerce to nullable type.
Attachments
Issue Links
- links to