Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5870

Support for passing Job priority through Application Submission Context in Mapreduce Side

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.8.0, 3.0.0-alpha1
    • client
    • None
    • Reviewed

    Description

      Job Priority support in MapReduce.

      1. Job Priority can be set from client side as below (Configuration and api).

      • JobConf.getJobPriority() and JobConf.setJobPriority(JobPriority priority)
      • We can also use configuration "mapreduce.job.priority".

      Now this Job priority can be passed in Application Submission context from Client side.
      Here we can reuse the MRJobConfig.PRIORITY configuration.
      2. CLI changes to support --set-priority. Run time change of JobPriority is also to be handled.
      3. Change Job to have the support for setPriority and getPriority (getter is handled with JobStatus)

      Attachments

        1. 0012-MAPREDUCE-5870.patch
          36 kB
          Sunil G
        2. 0011-MAPREDUCE-5870.patch
          36 kB
          Sunil G
        3. 0010-MAPREDUCE-5870.patch
          34 kB
          Sunil G
        4. 0009-MAPREDUCE-5870.patch
          33 kB
          Sunil G
        5. 0008-MAPREDUCE-5870.patch
          33 kB
          Sunil G
        6. 0007-MAPREDUCE-5870.patch
          29 kB
          Sunil G
        7. 0006-MAPREDUCE-5870.patch
          32 kB
          Sunil G
        8. 0005-MAPREDUCE-5870.patch
          32 kB
          Sunil G
        9. 0004-MAPREDUCE-5870.patch
          13 kB
          Sunil G
        10. 0003-MAPREDUCE-5870.patch
          6 kB
          Sunil G
        11. 0002-MAPREDUCE-5870.patch
          6 kB
          Sunil G
        12. 0001-MAPREDUCE-5870.patch
          3 kB
          Sunil G
        13. Yarn-2002.1.patch
          2 kB
          Sunil G

        Issue Links

        depends upon

        Sub-task - The sub-task of the issue YARN-4014 Support user cli interface in for Application Priority

        • Major - Major loss of function.
        • Resolved
        is related to

        Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-6515 Update Application priority in AM side from AM-RM heartbeat

        • Major - Major loss of function.
        • Resolved

        New Feature - A new feature of the product, which has yet to be developed. YARN-1963 Support priorities across applications within the same queue

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            sunilg Sunil G
            sunilg Sunil G
            Votes:
            0 Vote for this issue
            Watchers:
            15 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment