Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-24913 LlapTaskScheduler Improvements
  3. HIVE-24914

Improve LLAP scheduling by only traversing hosts with capacity

    XMLWordPrintableJSON

Details

    Description

      schedulePendingTasks on the LlapTaskScheduler currently goes through all the pending tasks and tries to allocate them based on their Priority – if a priority can not be scheduled completely, we bail out as lower priorities would not be able to get allocations either.

      An optimization here could be to only walk through the nodes with capacity (if any) ,and not all available hosts, for scheduling these tasks based on their priority and locality preferences.

      Attachments

        Issue Links

          Activity

            People

              pgaref Panagiotis Garefalakis
              pgaref Panagiotis Garefalakis
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1.5h
                  1.5h