Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
Description
ParquetRewriter's RewriteOptions makes use of Hadoop Path and Configuration, where it could instead allow users to specify these using the Parquet interface methods as well. This would allow for proper decoupling Hadoop for rewriting in a later stage as well.
This is part of a larger effort to decouple Parquet from Hadoop libraries.