Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6216

Unify Container Resizing code paths with Container Updates making it scheduler agnostic

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      YARN-5959 introduced an ContainerUpdateContext which can be used to update the ExecutionType of a container in a scheduler agnostic manner. As mentioned in that JIRA, extending that to encompass Container resizing is trivial.
      This JIRA proposes to remove all the CapacityScheduler specific code paths. (CapacityScheduler, CSQueue, FicaSchedulerApp etc.) and modify the code to use the framework introduced in YARN-5959 without any loss of functionality.

      Attachments

        1. YARN-6216.001.patch
          135 kB
          Arun Suresh
        2. YARN-6216.002.patch
          141 kB
          Arun Suresh
        3. YARN-6216.003.patch
          154 kB
          Arun Suresh
        4. YARN-6216-branch-2.001.patch
          156 kB
          Arun Suresh

        Issue Links

        incorporates

        Sub-task - The sub-task of the issue YARN-6181 SchedulerRequestKey compareTo method neglects to compare containerToUpdate

        • Major - Major loss of function.
        • Resolved
        is related to

        Bug - A problem which impairs or prevents the functions of the product. YARN-6251 Do async container release to prevent deadlock during container updates

        • Major - Major loss of function.
        • Resolved
        is required by

        Sub-task - The sub-task of the issue YARN-1655 Add implementations to FairScheduler to support increase/decrease container resource

        • Major - Major loss of function.
        • Patch Available
        relates to

        Sub-task - The sub-task of the issue YARN-5959 RM changes to support change of container ExecutionType

        • Major - Major loss of function.
        • Resolved
        supercedes

        Sub-task - The sub-task of the issue YARN-1651 CapacityScheduler side changes to support increase/decrease container resource.

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            asuresh Arun Suresh
            asuresh Arun Suresh
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment