Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
If the intermediate data is already partitioned on a certain expression (key), the repartition doesn't have to be added (in a join), or should be removed in an optimization rule. This will avoid having to repartition (and maybe shuffle in Ballista).