Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-6540

Autoscaling should be aware of Streaming RPC Quota

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.11.0
    • Fix Version/s: 2.11.0
    • Component/s: runner-dataflow
    • Labels:
      None

      Description

      Streaming Windmill Service introduces quota for the shared windmill workers.  Autoscaling needs to be aware of throttling due to this quota in order to not upscale.  This PR adds in that reporting.

       

      It also introduces the flag --EnableStreamingEngine.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                takidau Tyler Akidau
                Reporter:
                dustin12 Dustin Rhodes
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 7.5h
                  7.5h