Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
CentOS Version : centos-release-7-9.2009.1.el7.centos.x86_64
Java Version : openjdk version "11.0.13" 2021-10-19 LTS
Scala Version : 2.12.10
Spark Version : 3.1.2
Hadoop Version : Tested with both : 3.2 and 2.7
Apache Livy : https://github.com/apache/incubator-livy : Re-compiled it for Scala 2.12
Description
Hi All,
I am using the Livy Programmatic API.
I am unable to submit the job when Apache Livy is running on CentOS 7.9 whereas it works absolutely fine when I run the Job on CentOS 8.2 . I get the errors (Kryro Class not found exception) as mentioned in the attached File Error.txt
Error.txt . The JAR file uploads successfully to the .livy-sessions directory . Also , the livy-sessions directory is whitelisted in the livy.conf .
Java version : Tried with both Java 8 and Java 11
Spark Version : 3.1.2 .
Livy Version : Cloned the latest version from github compatible with scala 2.12
Scala version : 2.12.10