Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-28464

Document kafka minPartitions option in "Structured Streaming + Kafka Integration Guide"

    XMLWordPrintableJSON

Details

    • Documentation
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.4.3, 3.0.0
    • 2.4.4, 3.0.0
    • Documentation
    • None

    Description

      SPARK-23541 added the option "minPartitions" to Kafka source. "minPartitions" is missing in the "Structured Streaming + Kafka Integration Guide" and needs to be documented.

      Attachments

        Issue Links

          relates to

          New Feature - A new feature of the product, which has yet to be developed. SPARK-23541 Allow Kafka source to read data with greater parallelism than the number of topic-partitions

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #25219

          Activity

            People

              arunpandianp Arun Pandian
              arunpandianp Arun Pandian
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: