Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-19749 Acid V1 to V2 upgrade
  3. HIVE-19598

Add Acid V1 to V2 upgrade module

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 3.0.0
    • 3.1.0
    • Transactions
    • None

    Description

      The on-disk layout for full acid (transactional) tables has changed 3.0.

      Any transactional table that has any update/delete events in any deltas that have not been Major compacted, must go through a Major compaction before upgrading to 3.0.  No more update/delete/merge should be run after/during major compaction.

      Not doing so will result in data corruption/loss.

       

      Need to create a utility tool to help with this process.  HIVE-19233 started this but it needs more work.

      Attachments

        1. HIVE-19598.01-branch-3.patch
          88 kB
          Eugene Koifman
        2. HIVE-19598.02.patch
          57 kB
          Eugene Koifman
        3. HIVE-19598.05.patch
          87 kB
          Eugene Koifman
        4. HIVE-19598.06.patch
          88 kB
          Eugene Koifman

        Issue Links

          is required by

          Sub-task - The sub-task of the issue HIVE-19751 create submodule of hive-upgrade-acid for preUpgrade and postUpgrade

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-19599 Release Notes : Highlighting backwards incompatible changes

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HIVE-19233 Add utility for acid 1.0 to 2.0 migration

          • Major - Major loss of function.
          • Closed
          supercedes

          Test - A new unit, integration or system test. HIVE-19553 Enable TestTxnExIm#testUpgrade

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          links to

          Web Link RB

          Activity

            People

              ekoifman Eugene Koifman
              ekoifman Eugene Koifman
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: