Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-31063

xml-apis is missing after xercesImpl bumped up to 2.12.0

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Not A Problem
    • 3.0.0, 3.1.0
    • None
    • Spark Core
    • None

    Description

       ✘ kentyao@hulk  ~/Downloads/spark/spark-3.1.0-SNAPSHOT-bin-20200305  bin/spark-sql
      20/03/06 11:05:58 WARN Utils: Your hostname, hulk.local resolves to a loopback address: 127.0.0.1; using 10.242.189.214 instead (on interface en0)
      20/03/06 11:05:58 WARN Utils: Set SPARK_LOCAL_IP if you need to bind to another address
      Exception in thread "main" java.lang.NoClassDefFoundError: org/w3c/dom/ElementTraversal
      	at java.lang.ClassLoader.defineClass1(Native Method)
      	at java.lang.ClassLoader.defineClass(ClassLoader.java:756)
      	at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
      	at java.net.URLClassLoader.defineClass(URLClassLoader.java:468)
      	at java.net.URLClassLoader.access$100(URLClassLoader.java:74)
      	at java.net.URLClassLoader$1.run(URLClassLoader.java:369)
      	at java.net.URLClassLoader$1.run(URLClassLoader.java:363)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at java.net.URLClassLoader.findClass(URLClassLoader.java:362)
      	at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
      	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:355)
      	at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
      	at org.apache.xerces.parsers.AbstractDOMParser.startDocument(Unknown Source)
      	at org.apache.xerces.xinclude.XIncludeHandler.startDocument(Unknown Source)
      	at org.apache.xerces.impl.dtd.XMLDTDValidator.startDocument(Unknown Source)
      	at org.apache.xerces.impl.XMLDocumentScannerImpl.startEntity(Unknown Source)
      	at org.apache.xerces.impl.XMLVersionDetector.startDocumentParsing(Unknown Source)
      	at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source)
      	at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source)
      	at org.apache.xerces.parsers.XMLParser.parse(Unknown Source)
      	at org.apache.xerces.parsers.DOMParser.parse(Unknown Source)
      	at org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source)
      	at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:150)
      	at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2482)
      	at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2470)
      	at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2541)
      	at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2494)
      	at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2407)
      	at org.apache.hadoop.conf.Configuration.set(Configuration.java:1143)
      	at org.apache.hadoop.conf.Configuration.set(Configuration.java:1115)
      	at org.apache.spark.deploy.SparkHadoopUtil$.org$apache$spark$deploy$SparkHadoopUtil$$appendS3AndSparkHadoopHiveConfigurations(SparkHadoopUtil.scala:456)
      	at org.apache.spark.deploy.SparkHadoopUtil$.newConfiguration(SparkHadoopUtil.scala:427)
      	at org.apache.spark.deploy.SparkSubmit.$anonfun$prepareSubmitEnvironment$2(SparkSubmit.scala:342)
      	at scala.Option.getOrElse(Option.scala:189)
      	at org.apache.spark.deploy.SparkSubmit.prepareSubmitEnvironment(SparkSubmit.scala:342)
      	at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:871)
      	at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:180)
      	at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:203)
      	at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:90)
      	at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1007)
      	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1016)
      	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
      Caused by: java.lang.ClassNotFoundException: org.w3c.dom.ElementTraversal
      	at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
      	at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
      	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:355)
      	at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
      	... 42 more
      
      

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              Qin Yao Kent Yao 2
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: