Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-21450

Add local recovery support to adaptive scheduler

    XMLWordPrintableJSON

Details

    Description

      local recovery means that, on a failure, we are able to re-use the state in a taskmanager, instead of loading it again from distributed storage (which means the scheduler needs to know where which state is located, and schedule tasks accordingly).

      Adaptive Scheduler is currently not respecting the location of state, so failures require the re-loading of state from the distributed storage.

      Adding this feature will allow us to enable the Local recovery and sticky scheduling end-to-end test for adaptive scheduler again.

      Attachments

        Issue Links

          causes

          Technical Debt - FLINK-34409 Increase test coverage for AdaptiveScheduler

          • Major - Major loss of function.
          • Resolved
          depends upon

          New Feature - A new feature of the product, which has yet to be developed. FLINK-21075 FLIP-160: Adaptive scheduler

          • Major - Major loss of function.
          • Closed
          relates to

          Sub-task - The sub-task of the issue FLINK-21737 FileSourceTextLinesITCase.testContinuousTextFileSourceWithJobManagerFailover fails

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-31261 Make AdaptiveScheduler aware of the (local) state size

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-32816 Remove the local recovery limitation for adaptive scheduler

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #21981

          Activity

            People

              roman Roman Khachatryan
              rmetzger Robert Metzger
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: