Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-3764

Support metastore version consistency check

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.8.0, 0.9.0, 0.10.0, 0.11.0
    • 0.12.0
    • Metastore
    • None

    Description

      Today there's no version/compatibility information stored in hive metastore. Also the datanucleus configuration property to automatically create missing tables is enabled by default. If you happen to start an older or newer hive or don't run the correct upgrade scripts during migration, the metastore would end up corrupted. The autoCreate schema is not always sufficient to upgrade metastore when migrating to newer release. It's not supported with all databases. Besides the migration often involves altering existing table, changing or moving data etc.

      Hence it's very useful to have some consistency check to make sure that hive is using correct metastore and for production systems the schema is not automatically by running hive.

      Attachments

        1. HIVE-3764.1.patch
          39 kB
          Prasad Suresh Mujumdar
        2. HIVE-3764.2.patch
          40 kB
          Prasad Suresh Mujumdar
        3. HIVE-3764-12.3.patch
          40 kB
          Prasad Suresh Mujumdar
        4. HIVE-3764-trunk.3.patch
          163 kB
          Prasad Suresh Mujumdar

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. HIVE-5301 Add a schema tool for offline metastore schema upgrade

          • Major - Major loss of function.
          • Closed
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-6113 Upgrade DataNucleus [was: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient]

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HIVE-6862 add DB schema DDL and upgrade 12to13 scripts for MS SQL Server

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HIVE-5606 Default Derby metastore_db initial creation fails if hive.metastore.schema.verification=true

          • Major - Major loss of function.
          • Patch Available

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-1841 datanucleus.fixedDatastore should be true in hive-default.xml

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Task - A task that needs to be done. HIVE-12436 Default hive.metastore.schema.verification to true

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-5427 TestMetastoreVersion.testVersionRestriction fails on hive 0.12

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Activity

            People

              prasadm Prasad Suresh Mujumdar
              prasadm Prasad Suresh Mujumdar
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: