Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-10400

DirectRunner: race condition in watermark update

Details

    • Bug
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • 2.23.0
    • 2.24.0
    • runner-direct
    • None

    Description

      When watermark is updated in upstream PTransform, it is instantly propagated as input watermark to all directly connected downstream PTransforms. We must ensure that all output bundles that were emitted before the watermark update are processed before we allow updating input watermark of downstream PTransform.

      Attachments

        Issue Links

          Activity

            People

              janl Jan Lukavský
              janl Jan Lukavský
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 3h 20m
                  3h 20m