Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-30364

The spark-streaming-kafka-0-10_2.11 test cases are failing on ppc64le

    XMLWordPrintableJSON

Details

    • Test
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • 2.4.0
    • None
    • Build, DStreams

    • os: rhel 7.6
      arch: ppc64le

    Description

      I have been trying to build the Apache Spark on rhel_7.6/ppc64le; however, the spark-streaming-kafka-0-10_2.11 test cases are failing with following error :

      [ERROR] /opt/spark/external/kafka-0-10/src/test/scala/org/apache/spark/streaming/kafka010/KafkaDataConsumerSuite.scala:85: Symbol 'term org.eclipse' is missing from the classpath.
This symbol is required by 'method org.apache.spark.metrics.MetricsSystem.getServletHandlers'.
Make sure that term eclipse is in your classpath and check for conflicting dependencies with `-Ylog-classpath`.
A full rebuild may help if 'MetricsSystem.class' was compiled against an incompatible version of org.
[ERROR]     testUtils.sendMessages(topic, data.toArray)                                  ^

      Would like some help on understanding the cause for the same . I am running it on a High end VM with good connectivity.

      Attachments

        Activity

          People

            Unassigned Unassigned
            AK2019 AK97
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: