Details
-
Bug
-
Status: Resolved
-
P1
-
Resolution: Fixed
-
2.25.0
-
None
Description
If ParquetIO.read()
- is used with withConfiguration() and FilterPredicate,
- is used with withSplit(),
- and filtered records are not in the beginning of the reading block
then they will be skipped and it will cause a data loss.