Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-46866

Streaming python data source API

    XMLWordPrintableJSON

Details

    • Epic
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 4.0.0
    • None
    • Structured Streaming
    • None

    Description

      This is a follow up of https://issues.apache.org/jira/browse/SPARK-44076. The idea is to enable Python developers to develop streaming data sources in python. The goal is to make a Python-based API that is simple and easy to use, thus making Spark more accessible to the wider Python developer community.

       

      Design doc: https://docs.google.com/document/d/1cJ-w1hGPOBFp-5DLmf68sTLsAOwb55oW6SAuuAUFEM4/edit

      Attachments

        Activity

          People

            Unassigned Unassigned
            Chaoqin Chaoqin Li
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: