Details
-
Epic
-
Status: Open
-
Major
-
Resolution: Unresolved
-
4.0.0
-
None
-
None
Description
This is a follow up of https://issues.apache.org/jira/browse/SPARK-44076. The idea is to enable Python developers to develop streaming data sources in python. The goal is to make a Python-based API that is simple and easy to use, thus making Spark more accessible to the wider Python developer community.
Design doc: https://docs.google.com/document/d/1cJ-w1hGPOBFp-5DLmf68sTLsAOwb55oW6SAuuAUFEM4/edit