Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-27692

Explore removing the always task from embedded HMS

    XMLWordPrintableJSON

Details

    Description

      The always tasks are running in the leader HMS now, the properties for configuring the leader should only belong to HMS, other engines such as Spark/Impala doesn't need to know these properties. For most cases, the engine only cares about the properties for connecting HMS, e.g, hive.metastore.uris.

      Every time when a new apps uses an embedded Metastore, it will start the HMS always tasks by default. Imaging we have hundreds of apps, then hundreds of pieces of the same tasks are running, this will put extra burden to the underlying databases, such as the flooding queries, connection limit.

      I think we can remove always tasks from the embeded Metastore, the always task will be taken care of by the standalone Metastore, as a standalone Metastore should be here in production environment.

      Attachments

        Issue Links

          Activity

            People

              dengzh Zhihua Deng
              dengzh Zhihua Deng
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: