Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-19878

Hive On Spark support AM shut down when there is no job submit

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Patch Available
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • Spark
    • None

    Description

      the Application Master of Hive on Spark always live on the yarn if the Hive client do not exit(such as one session in HiveServer2), which will accupy lots of resources, we should control the AM shut down when there is no more jobs submit.

      Now Tez use the param ` tez.session.am.dag.submit.timeout.secs` to control the DAGAppMaster on the yarn to shut down.

      So here Spark need to do this too.

      Attachments

        1. HIVE-19878.1.patch
          7 kB
          Song Jun

        Issue Links

          Activity

            People

              windpiger Song Jun
              windpiger Song Jun
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: