Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Duplicate
-
2.4.0
-
None
-
None
Description
This interface was created for file source(not migrated yet) to implement hive partition pruning. It turns out that, we can also use the public Filter API in the hive partition pruning. Thus we don't need SupportsPushdownCatalystFilter at all, which exposed the internal Expression class.
Attachments
Issue Links
- duplicates
-
SPARK-25127 DataSourceV2: Remove SupportsPushDownCatalystFilters
- Resolved