Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-14107

Kinesis consumer record emitter deadlock under event time alignment

    XMLWordPrintableJSON

Details

    Description

      When the emitter reaches the max timestamp for the current queue, it stops emitting and waits for the max timestamp to advance. Since it simultaneously selects the next queue as the new "minimum" queue, it may deadlock if the previous min queue represents the new global lower bound after the max timestamp advanced. This occurs very infrequently and we were finally able to reproduce.

      Attachments

        Activity

          People

            thw Thomas Weise
            thw Thomas Weise
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 1h
                1h