Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-25318 Improvement of scheduler and execution for Flink OLAP
  3. FLINK-25329

Improvement of execution graph store in flink session cluster for jobs

    XMLWordPrintableJSON

Details

    Description

      Flink session cluster uses files to store info of jobs after they reach termination with `FileExecutionGraphInfoStore`, each job will generate one file. When the cluster executes many small jobs concurrently, there will be many disk related operations, which will

      1> Increase the CPU usage of `Dispatcher`
      2> Decrease the performance of the jobs in the cluster.

      We hope to improve the disk operations in `FileExecutionGraphInfoStore` to increase the performance of session cluster, or support memory store.

      Attachments

        Issue Links

          Activity

            People

              zjureel Fang Yong
              zjureel Fang Yong
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: