Details
-
Improvement
-
Status: Open
-
Minor
-
Resolution: Unresolved
-
3.5.0
-
None
-
None
Description
tl;dr – sometimes the driver can get overwhelmed serving the initial jar set. You'll see a lot of "Executor fetching spark://.../....jar" and then connection timed out.
On YARN the jars (in cluster mode) are cached in HDFS.