Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-30165 Eliminate compilation warnings
  3. SPARK-30169

Eliminate warnings in Kafka connector

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 3.1.0
    • None
    • SQL
    • None

    Description

      Eliminate compilation warnings (10) in module external/kafka-0-10:

      1. spark/external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/ConsumerStrategy.scala

      Line:108
method poll in class KafkaConsumer is deprecated: see corresponding Javadoc for more information.
Line:162
method poll in class KafkaConsumer is deprecated: see corresponding Javadoc for more information.

      2. spark/external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/KafkaDataConsumer.scala

      Line:206
method poll in class KafkaConsumer is deprecated: see corresponding Javadoc for more information.

      3. spark/external/kafka-0-10/src/test/scala/org/apache/spark/streaming/kafka010/DirectKafkaStreamSuite.scala

      Line:258
method poll in trait Consumer is deprecated: see corresponding Javadoc for more information.
Line:314
method poll in trait Consumer is deprecated: see corresponding Javadoc for more information.
Line:476
method poll in class KafkaConsumer is deprecated: see corresponding Javadoc for more information.

      4. spark/external/kafka-0-10/src/test/scala/org/apache/spark/streaming/kafka010/KafkaTestUtils.scala

      Line:60
class ZkUtils in package utils is deprecated (since 2.0.0): This is an internal class that is no longer used by Kafka and will be removed in a future release. Please use org.apache.kafka.clients.admin.AdminClient instead.
Line:88
class ZkUtils in package utils is deprecated (since 2.0.0): This is an internal class that is no longer used by Kafka and will be removed in a future release. Please use org.apache.kafka.clients.admin.AdminClient instead.
Line:100
object ZkUtils in package utils is deprecated (since 2.0.0): This is an internal class that is no longer used by Kafka and will be removed in a future release. Please use org.apache.kafka.clients.admin.AdminClient instead.
Line:178
method createTopic in object AdminUtils is deprecated (since 1.1.0): This method is deprecated and will be replaced by kafka.zk.AdminZkClient.

      Eliminate compilation warnings (13) in module external/kafka-0-10-sql:

      1. spark/external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaDataConsumer.scala

      Line:74
 method poll in class KafkaConsumer is deprecated: see corresponding Javadoc for more information.

      2. spark/external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaOffsetReader.scala

      Line:119
method poll in trait Consumer is deprecated: see corresponding Javadoc for more information.
Line:382
method poll in trait Consumer is deprecated: see corresponding Javadoc for more information.

      3. spark/external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaTestUtils.scala

      Line:84
class ZkUtils in package utils is deprecated (since 2.0.0): This is an internal class that is no longer used by Kafka and will be removed in a future release. Please use org.apache.kafka.clients.admin.AdminClient instead.
Line:118
class ZkUtils in package utils is deprecated (since 2.0.0): This is an internal class that is no longer used by Kafka and will be removed in a future release. Please use org.apache.kafka.clients.admin.AdminClient instead.
Line:246
class ZkUtils in package utils is deprecated (since 2.0.0): This is an internal class that is no longer used by Kafka and will be removed in a future release. Please use org.apache.kafka.clients.admin.AdminClient instead.
Line: 458
method poll in class KafkaConsumer is deprecated: see corresponding Javadoc for more information.
Line: 472
method poll in class KafkaConsumer is deprecated: see corresponding Javadoc for more information.
Line: 581
object ZkUtils in package utils is deprecated (since 2.0.0): This is an internal class that is no longer used by Kafka and will be removed in a future release. Please use org.apache.kafka.clients.admin.AdminClient instead.
Line: 582
object ZkUtils in package utils is deprecated (since 2.0.0): This is an internal class that is no longer used by Kafka and will be removed in a future release. Please use org.apache.kafka.clients.admin.AdminClient instead.
Line: 583
object ZkUtils in package utils is deprecated (since 2.0.0): This is an internal class that is no longer used by Kafka and will be removed in a future release. Please use org.apache.kafka.clients.admin.AdminClient instead.
Line: 583
object ZkUtils in package utils is deprecated (since 2.0.0): This is an internal class that is no longer used by Kafka and will be removed in a future release. Please use org.apache.kafka.clients.admin.AdminClient instead.
Line: 607
object ZkUtils in package utils is deprecated (since 2.0.0): This is an internal class that is no longer used by Kafka and will be removed in a future release. Please use org.apache.kafka.clients.admin.AdminClient instead.

      Attachments

        Issue Links

          contains

          Bug - A problem which impairs or prevents the functions of the product. SPARK-28367 Kafka connector infinite wait because metadata never updated

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              Unassigned Unassigned
              maxgekk Max Gekk
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: