[FLINK-22815] Disable unaligned checkpoints for broadcast partitioning - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Blocker
Resolution: Fixed
Affects Version/s: 1.13.1, 1.12.4
Fix Version/s: 1.11.4, 1.14.0, 1.12.5, 1.13.2
Component/s: Runtime / Checkpointing
Labels:
- pull-request-available

Release Note:

Hide
Unaligned checkpoints were disabled for BROADCAST exchanges.

Broadcast partitioning can not work with unaligned checkpointing. There are no guarantees that records are consumed at the same rate in all
channels. This can result in some tasks applying state changes corresponding to a certain broadcasted event while others don't. In turn
upon restore, it may lead to an inconsistent state.

Show
Unaligned checkpoints were disabled for BROADCAST exchanges. Broadcast partitioning can not work with unaligned checkpointing. There are no guarantees that records are consumed at the same rate in all channels. This can result in some tasks applying state changes corresponding to a certain broadcasted event while others don't. In turn upon restore, it may lead to an inconsistent state.

Description

Broadcast partitioning can not work with unaligned checkpointing. There
are no guarantees that records are consumed at the same rate in all
channels. This can result in some tasks applying state changes
corresponding to a certain broadcasted event while others don't. In turn
upon restore, it may lead to an inconsistent state.

Attachments

Issue Links

relates to

FLINK-22686 Incompatible subtask mappings while resuming from unaligned checkpoints

Closed

links to

GitHub Pull Request #16066

GitHub Pull Request #16089

Activity

People

Assignee:: Dawid Wysakowicz

Reporter:: Dawid Wysakowicz

Votes:: 0 Vote for this issue

Watchers:: 5 Start watching this issue

Dates

Created:: 31/May/21 15:41

Updated:: 23/Sep/21 17:24

Resolved:: 18/Jun/21 08:08