Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-28928

Use Kafka delegation token protocol on sources/sinks

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 3.0.0
    • Component/s: Structured Streaming
    • Labels:
      None

      Description

      At the moment there are 3 places where communication protocol with Kafka cluster has to be configured:

      • On delegation token
      • On source
      • On sink

      Most of the time users are using the same protocol on all these places (within one Kafka cluster). It would be better to declare it in one place (delegation token side) and Kafka sources/sinks can take this config over.

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                gsomogyi Gabor Somogyi
                Reporter:
                gsomogyi Gabor Somogyi
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: