Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-13684

Consider adding information to ProcessBundleRequest indicating there is no existing state

Details

    • Improvement
    • Status: Open
    • P3
    • Resolution: Unresolved
    • None
    • None
    • beam-model
    • None

    Description

      This allows for skipping all state fetches made during processing this key, preloading the cache with empty values for the key, or extending the cache to include this negative state information to avoid fetches as long as no state is evicted for the key.

      This is particularly beneficial in sparse key streaming pipelines where such new keys are common.

      It could also be used to avoid fetches in batch pipelines where there is no persisted state.

      Attachments

        Activity

          People

            Unassigned Unassigned
            scwhittle Sam Whittle
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated: