Uploaded image for project: 'Mesos'
  1. Mesos
  2. MESOS-3157

Only perform periodic resource allocations.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • allocation
    • None

    Description

      Our deployment environments have a lot of churn, with many short-live frameworks that often revive offers. Running the allocator takes a long time (from seconds up to minutes).

      In this situation, event-triggered allocation causes the event queue in the allocator process to get very long, and the allocator effectively becomes unresponsive (eg. a revive offers message takes too long to come to the head of the queue).

      We have been running a patch to remove all the event-triggered allocations and only allocate periodically on the allocation interval. This works great and really improves responsiveness.

      Attachments

        Issue Links

          contains

          Improvement - An improvement or enhancement to an existing feature or task. MESOS-2285 Eliminate dependency on master::Flags in Allocator

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          duplicates

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. MESOS-4766 Improve allocator performance.

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. MESOS-4767 Apply batching to allocation events to reduce allocator backlogging.

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. MESOS-4102 Quota doesn't allocate resources on slave joining.

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. MESOS-3353 generic mechanism to smuggle allocation options

          • Critical - Crashes, loss of data, severe memory leak.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. MESOS-4694 DRFAllocator takes very long to allocate resources with a large number of frameworks

          • Major - Major loss of function.
          • Resolved
          is superceded by

          Bug - A problem which impairs or prevents the functions of the product. MESOS-6904 Perform batching of allocations to reduce allocator queue backlogging.

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. MESOS-3078 Recovered resources are not re-allocated until the next allocation delay.

          • Major - Major loss of function.
          • Reviewable

          Activity

            People

              Unassigned Unassigned
              jamespeach James Peach
              Benjamin Mahler Benjamin Mahler
              Votes:
              1 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: