Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-2437

Avoid flushing at Parquet writes after an exception

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.14.0
    • parquet-mr
    • None

    Description

      The different levels of Parquet writer classes (e.g. ColumnWriterBase) does a flush when close() is invoked. This is completely fine in normal scenario but in case of an exception happened this may lead to serious issues including JVM crash.

      Attachments

        Issue Links

          Activity

            People

              gszadovszky Gabor Szadovszky
              gszadovszky Gabor Szadovszky
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: