SQL: to_date function can't parse date strings in different locales.

The locale for org.apache.spark.sql.catalyst.util.DateTimeUtils, that is internally used by to_date SQL function, is set in code to be Locale.US.

This causes problems parsing a dataset which has dates in a different (italian in this case) language.

spark.read.format("csv")
            .option("sep", ";")
            .csv(logFile)
            .toDF("DATA", .....)
            .withColumn("DATA2", to_date(col("DATA"), "yyyy MMM"))
            .show(10)

Results from example dataset:

Expected results: All values converted.

TEMPORARY WORKAROUND:

In object org.apache.spark.sql.catalyst.util.DateTimeUtils, replace all instances of Locale.US with Locale.<your locale>

ADDITIONAL NOTES:

I can make a pull request available on GitHub.