Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-33937

Move the old partition data to trash instead of deleting it when inserting rewrite hive table

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Duplicate
    • 3.2.0
    • 3.2.0
    • SQL
    • None

    Description

      InsertIntoHiveTable should move the old partition data to trash instead of deleting it.

      Because that's what we do in hive.

      https://github.com/apache/hive/blob/9c6f8b76123c88b0c8a98645874722ba80b3c2b0/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java

      `deleteOldPathForReplace`

      Attachments

        Activity

          People

            Unassigned Unassigned
            searise 黄海升
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: