Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8221

NullPointerException in reading from non-existent Kafka topic

Details

    • Bug
    • Status: Resolved
    • P3
    • Resolution: Fixed
    • None
    • 2.29.0
    • io-java-kafka
    • None

    Description

      Get this exception when launch apache beam job, which tries to read from non-existent Kafka topic:

      Exception in thread "main" java.lang.RuntimeException: java.lang.NullPointerException
      	at org.apache.beam.runners.dataflow.ReadTranslator.translateReadHelper(ReadTranslator.java:54)
      	at org.apache.beam.runners.dataflow.DataflowRunner$StreamingUnboundedRead$ReadWithIdsTranslator.translate(DataflowRunner.java:1508)
      	at org.apache.beam.runners.dataflow.DataflowRunner$StreamingUnboundedRead$ReadWithIdsTranslator.translate(DataflowRunner.java:1505)
      	at org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator.visitPrimitiveTransform(DataflowPipelineTranslator.java:475)
      	at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:665)
      	at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:657)
      	at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:657)
      	at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:657)
      	at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:317)
      	at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:251)
      	at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:458)
      	at org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator.translate(DataflowPipelineTranslator.java:414)
      	at org.apache.beam.runners.dataflow.DataflowPipelineTranslator.translate(DataflowPipelineTranslator.java:173)
      	at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:737)
      	at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:179)
      	at org.apache.beam.sdk.Pipeline.run(Pipeline.java:313)
      	at org.apache.beam.sdk.Pipeline.run(Pipeline.java:299)
      	at com.paloaltonetworks.cortex.replication.ingest.ReplicationIngestor.run(ReplicationIngestor.java:109)
      	at com.paloaltonetworks.cortex.replication.ingest.ReplicationIngestor.main(ReplicationIngestor.java:64)
      Caused by: java.lang.NullPointerException
      	at org.apache.beam.sdk.io.kafka.KafkaUnboundedSource.split(KafkaUnboundedSource.java:66)
      	at org.apache.beam.runners.dataflow.internal.CustomSources.serializeToCloudSource(CustomSources.java:87)
      	at org.apache.beam.runners.dataflow.ReadTranslator.translateReadHelper(ReadTranslator.java:51)
      	... 18 more 

      Attachments

        Issue Links

          Activity

            People

              aromanenko Alexey Romanenko
              chandankumar Chandan Kumar
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 20m
                  1h 20m