Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Not A Bug
-
3.5.1
-
None
Description
while writing bug test for SPARK-45866, found that canonicalization of SubqueryAdaptiveBroadcastExec is broken in the sense that buildPlan : LogicalPlan is not canonicalized which causes batchscans to differ when reuse of exchange check happens in AQE.
Moreover the equivalence of SubqueryAdaptiveBroadcastExec and SubqueryBroadcastExec is not there which also aggravates the re-use of exchange in aqe broken.
Attachments
Attachments
Issue Links
- is required by
-
SPARK-45866 Reuse of exchange in AQE does not happen when run time filters are pushed down to the underlying Scan ( like iceberg )
- Open
- links to