Uploaded image for project: 'Sling'
  1. Sling
  2. SLING-5387

Provide support for running singleton jobs on non leader cluster nodes also

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • Commons Scheduler 2.6.0
    • Commons
    • None

    Description

      With SLING-2979 support for running singleton jobs on specific instance was provided. In most cases we want to run a job as singleton and not want to "pin" it to specific nodes. For this scheduler.runOn needs to be set to SINGLE.

      However per current implementation SINGLE is treated as LEADER. This effectively causes all singleton jobs to get executed on leader only thus putting extra load.

      For better utilization of cluster resources it should be possible to distribute such singleton jobs on other cluster nodes and still ensure that singleton contract is honoured!

      We would like to make use of this feature to ensure Oak AsyncIndexTask to run on different cluster nodes (OAK-2749)

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. SLING-7037 Scheduler does not retain provided name

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. OAK-6605 Provide job name for async index update

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          relates to

          New Feature - A new feature of the product, which has yet to be developed. SLING-2979 Add support for running scheduled task on specific instances

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. OAK-1246 Make AsynchIndexUpdate task to run only on a single node in a cluster

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. OAK-2749 Provide a "different lane" for slow indexers in async indexing

          • Major - Major loss of function.
          • Closed

          Activity

            People

              cziegeler Carsten Ziegeler
              chetanm Chetan Mehrotra
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: