Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-22911 Migrate structured streaming sources to new DataSourceV2 APIs
  3. SPARK-23196

Unify continuous and microbatch V2 sinks

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.4.0
    • 2.3.0
    • Structured Streaming
    • None

    Description

      We currently have separate MicroBatchWriteSupport and ContinuousWriteSupport. But these do fundamentally the same thing, and existing implementations are nearly equivalent but against slightly different interfaces. We should just unify them as StreamWriteSupport.

      Attachments

        Activity

          People

            joseph.torres Jose Torres
            joseph.torres Jose Torres
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: