Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-34973

FLIP-425: Asynchronous Execution Model

    XMLWordPrintableJSON

Details

    Description

      This is a sub-FLIP for the disaggregated state management and its related work, please read the FLIP-423 first to know the whole story.

      FLIP-424 introduces asynchronous state APIs with callbacks allowing state access to be executed in threads separate from the task thread, making better usage of I/O bandwidth and enhancing throughput. This FLIP proposes an execution framework for asynchronous state APIs. The execution code path for the new API is completely independent from the original one, where many runtime components are redesigned. We intend to delve into the challenges associated with asynchronous execution and provide an in-depth design analysis for each module. Furthermore, we will conduct a performance analysis of the new framework relative to the current implementation and examine how it measures up against other potential alternatives.

      Attachments

        Issue Links

          Activity

            People

              Yanfei Lei Yanfei Lei
              zakelly Zakelly Lan
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: