Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-28928

Use Kafka delegation token protocol on sources/sinks

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • Structured Streaming
    • None

    Description

      At the moment there are 3 places where communication protocol with Kafka cluster has to be configured:

      • On delegation token
      • On source
      • On sink

      Most of the time users are using the same protocol on all these places (within one Kafka cluster). It would be better to declare it in one place (delegation token side) and Kafka sources/sinks can take this config over.

       

      Attachments

        Issue Links

          Activity

            People

              gsomogyi Gabor Somogyi
              gsomogyi Gabor Somogyi
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: