Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-4036

Apache Storm 2.5.0 not able to start with Kafka 3.6.1

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsAdd voteVotersWatch issueWatchersCreate sub-taskConvert to sub-taskLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.5.0
    • None
    • storm-client
    • None
    • Linux
    • Important

    Description

      Hi Team,

      We are trying to use Apache Storm to pump in data using Kafka to another component. But as soon as we add the Kafka.properties to the storm conf folder, NMStormTopology and other processes fails with following error

      Exception in thread "main" java.lang.NoClassDefFoundError: org.apache.kafka.clients.producer.Producer
      at com.ibm.csi.nm.storm.app.NMStormTopology.validateKafkaConnection(NMStormTopology.java:126)
      at com.ibm.csi.nm.storm.app.NMStormTopology.main(NMStormTopology.java:170)
      Caused by: java.lang.ClassNotFoundException: org.apache.kafka.clients.producer.Producer
      at java.net.URLClassLoader.findClass(URLClassLoader.java:610)
      at java.lang.ClassLoader.loadClassHelper(ClassLoader.java:948)
      at java.lang.ClassLoader.loadClass(ClassLoader.java:893)
      at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:353)
      at java.lang.ClassLoader.loadClass(ClassLoader.java:876)

      We first start Kafka 3.6.1 server and then start storm 2.5.0.

      We are trying to understand which version of Kafka is compatible Storm 2.5.0? or this is a bug in storm which is not able to integrate with Kafka 3.6.1?

      with earlier version we didn't this issue but with this version we are seeing this. Help us to understand how to resolve this issue.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned Assign to me
            adisang Adarsh Shukla

            Dates

              Created:
              Updated:

              Slack

                Issue deployment