Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-4507

Late elements windowed into expired fixed windows get dropped in Directrunner

Details

    • Improvement
    • Status: Resolved
    • P2
    • Resolution: Won't Fix
    • 2.4.0
    • 2.5.0
    • runner-direct
    • None

    Description

      1- Create a elements that go into a combinar and then drops into a  Keyed Global Window, on entry setup a timer.
      Have the OnTime function:
      1- c.output the original element with a timestamp == to the original timestamp
      2- Create a new timestamp with element in the next window....
      2- LOG the output in a DoFn after the keyed state code, you should see all the values.
      3- Now apply a FixedWindow... and then try and log the output.. the original elements wont appear, but the new OnTime generated ones will.
       
      Tested in Dataflow runner and things work ok, the direct runner fails. 
       

      Attachments

        Activity

          People

            huygaa Batkhuyag Batsaikhan
            rarokni@gmail.com Reza ardeshir rokni
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: