Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-24913 LlapTaskScheduler Improvements
  3. HIVE-24116

LLAP: Provide an opportunity for preempted tasks to get better locality in next iteration

    XMLWordPrintableJSON

Details

    Description

      In certain DAGs, tasks get preempted as higher priority tasks need to be executed. These preempted tasks are scheduled to run later, but they end up missing locality information. Ref: HIVE-24061

      Remote storage reads can be avoided, if an opportunity is provided for these preempted to get better locality in next iteration.

       

      Attachments

        Issue Links

          Activity

            People

              rajesh.balamohan Rajesh Balamohan
              rajesh.balamohan Rajesh Balamohan
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m