Details
-
Bug
-
Status: Resolved
-
Minor
-
Resolution: Not A Problem
-
2.3.0, 2.4.0
-
None
-
None
Description
The spark csv writer does not consider "\r" as a newline in string type columns. As a result, the resulting csv are not quoted, and they get corrupted.
All \n, \r\n and \r should be considered as newline to allow robust csv serialization.