Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-21663 Hive Metastore Translation Layer
  3. HIVE-21816

HMS Translation: Refactor tests to work with ACID tables.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 4.0.0
    • 4.0.0-alpha-1
    • Hive
    • None

    Description

      1) TestHiveMetaStore unit tests does not work for full ACID tables as the TransactionalValidationListener enforces that this table use AcidIO. The Orc IO files are only included in the hive-exec jars that are not used by tests under standalone-metastore module. Even adding a test-scoped dependency on hive-exec did not work. I had to relocate these tests into itests.

      2) Implementation of logic that allows skipping of translation via the use of "MANAGERAWMETADATA" capability.

      3) Fixed some test bugs as the test was not failing originally when the createTable failed because of the issue in #1. As a result, about 3 tests never ran fully and never failed. The tests now fail if there are issues.

      4) Refactoring of the code in the DefaultTransformer to make static lists of capabilities. The return capabilities now is dependent on the table capabilities, the processor capabilities and the accessType assigned to the table.

      Attachments

        1. HIVE-21816.patch
          105 kB
          Naveen Gangam
        2. HIVE-21816.patch
          105 kB
          Naveen Gangam
        3. HIVE-21816.patch
          105 kB
          Naveen Gangam
        4. HIVE-21816.patch
          105 kB
          Naveen Gangam
        5. HIVE-21816.patch
          105 kB
          Naveen Gangam
        6. HIVE-21816.patch
          105 kB
          Naveen Gangam

        Issue Links

          Activity

            People

              ngangam Naveen Gangam
              ngangam Naveen Gangam
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: