Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-17923

dateFormat unexpected kwarg to df.write.csv

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Duplicate
    • 2.0.0
    • None
    • PySpark
    • None

    Description

      Calling like this:

      writer.csv(path, header=header, sep=sep, compression=compression, dateFormat=date_format)

      Getting the following error:

      TypeError: csv() got an unexpected keyword argument 'dateFormat'

      This error comes after being called with 

      date_format='yyyy-MM-dd'

      as an argument.

      Attachments

        Issue Links

          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-16216 CSV data source does not write date and timestamp correctly

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Activity

            People

              Unassigned Unassigned
              zamir.evan@gmail.com Evan Zamir
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: