Details
-
Improvement
-
Status: Resolved
-
P2
-
Resolution: Fixed
-
None
Description
It doesn't seem that ParquetIO.Sink has an option for setting row-group size. Its builder has a withConfiguration but it does not seem to change rowGroupSize in ParquetWriter.Builder and hence the default 128MB is used. It should be fairly easy to add the plumbing for setting this option here.
Attachments
Issue Links
- links to