Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6653

JobSubmitter with unmanaged MRApplicationMaster

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • applicationmaster, client
    • None

    Description

      Long living DAG applications (pig, hive, etc) may launch many mapreduce jobs. Since we already have to allocate resources for these clients, we could reduce the latency of monitoring AM's, the overall number of network RPC's, the number of containers running on YARN cluster by embedding the MRAppMaster with the submitter.

      Attachments

        Activity

          People

            Unassigned Unassigned
            jira.shegalov Gera Shegalov
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated: