Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-18320 Support ACID Tables Replication
  3. HIVE-18720

Replicate Commit Txn operation (without writes)

    XMLWordPrintableJSON

Details

    Description

      Add new EVENT_COMMIT_TXN to log the metadata/data of all tables/partitions modified within the txn.

      Source warehouse:

      • Create EVENT_COMMIT_TXN event type with corresponding message format etc.

      Target warehouse:

      • Repl load should read this event from the dump.
      • Validate the source txn ID from the event using the Source-Target Txn ID map maintained in target metastore. Also, need to check if corresponding target txn ID is valid.
      • If valid, then apply the event and commit the corresponding target transaction.
      • This new event should be idempotent such that if it is applied twice, then second time it should be loop.

        

      Attachments

        Issue Links

          Activity

            People

              maheshk114 mahesh kumar behera
              maheshk114 mahesh kumar behera
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: