Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-14225

load balance jenkins jobs

Details

    • Improvement
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • Not applicable
    • testing
    • None

    Description

      Jenkins can do automatic load balancing for cron jobs that use the "H" syntax [1], but we apply it only sporadically (and often incorrectly) in Beam. For example, the default setting is currently '0 */6 * * *' [2]. This means "every six hours, starting from exactly 00:00 (UTC)." Which creates load spikes every 6 hours, since a ton of jobs are run at once, rather than being staggered.

      [1] https://github.com/jenkinsci/jenkins/blob/master/core/src/main/resources/hudson/triggers/TimerTrigger/help-spec.jelly#L40-L41
      [2] https://github.com/apache/beam/blob/4dddaf9c3d70b5b858c16265abee4cdbf0c72631/.test-infra/jenkins/CronJobBuilder.groovy#L40

      Attachments

        Issue Links

          Activity

            People

              ibzib Kyle Weaver
              ibzib Kyle Weaver
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 50m
                  50m