Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-33773

Add fairness to scaling decisions

    XMLWordPrintableJSON

Details

    Description

      The current scaling logic is inherently unfair. In a scenario of heavy backlog, whichever pipelines come first, they will end up taking most of the resources. Some kind of fairness should be introduced, for example:

      • Cap the max number of resulting pods at a % of the cluster resources
      • Allow scale up round-robin across all pipelines

      Attachments

        Activity

          People

            mxm Maximilian Michels
            mxm Maximilian Michels
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: