Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
Currently if a unit test is using MiniGenericCluster it will have no difference from a simple local mode testing in Spark mode.
In order to run these tests properly with Yarn being involved we need to specify SPARK_MASTER=yarn-client as env var.