Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-38069

improve structured streaming window of calculated

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Trivial
    • Resolution: Fixed
    • 3.2.0
    • 3.3.0
    • Structured Streaming
    • None

    Description

      Structed Streaming computes window by intermediate result windowId, and windowId computes window by CaseWhen.

      We can use Flink's method of calculating window to write it, which is more easy to understand, simple and efficient

      Attachments

        Activity

          People

            nyingping nyingping
            nyingping nyingping
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: