Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-19435

Incremental replication cause data loss if a table is dropped followed by create and insert-into with different partition type.

    XMLWordPrintableJSON

    Details

    • Target Version/s:

      Description

      If the incremental dump have drop of partitioned table followed by create/insert on non-partitioned table with same name, doesn't replicate the data. Explained below.

      Let's say we have a partitioned table T1 which was already replicated to target.

      DROP_TABLE(T1)->CREATE_TABLE(T1) (Non-partitioned) -> INSERT(T1)(10) 

      After REPL LOAD, T1 doesn't have any data.

      Same is valid for non-partitioned to partitioned and partition spec mismatch case as well.

       

        Attachments

        1. HIVE-19435.01.patch
          7 kB
          Sankar Hariappan
        2. HIVE-19435.01-branch-3.patch
          7 kB
          Sankar Hariappan
        3. HIVE-19435.02.patch
          7 kB
          Sankar Hariappan
        4. HIVE-19435.03.patch
          7 kB
          Sankar Hariappan

          Issue Links

            Activity

              People

              • Assignee:
                sankarh Sankar Hariappan
                Reporter:
                sankarh Sankar Hariappan
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: