Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-7642

(Dataflow) Python AfterProcessingTime fires before defined time

Details

    • Bug
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.16.0
    • sdk-py-core
    • None

    Description

      https://stackoverflow.com/questions/56700913/why-my-data-in-apache-beam-is-emitted-after-a-few-minutes-instead-of-10h

       

      User on StackOverflow has a problem that AfterProcessingTime on global window fires before allocated time (10h). It dumps events within first minutes/seconds and then drops the rest due to window closed.

      Code user provided seems valid. I tried to verify time units accepted by the method, but I couldn't track it all the way through the code.

      Attachments

        Issue Links

          Activity

            People

              yichi Yichi Zhang
              Ardagan Mikhail Gryzykhin
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 20m
                  1h 20m