Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-25698

Hive column update performance too low when table partition over 700

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 3.1.1
    • None
    • None
    • CentOS 7.8 

      Hadoop 3.1.1

      Impala 3.4.0

    Description

      Now we using hive 3.1.1

       

      Currently in our hive we have tables with hundreds of partitions and hundreds of gigabytes of data.

       

      When updating the column information of the corresponding table, it was confirmed that the performance was several tens of times slower than the Hive 1.1 version of the existing CDH.

       

      I would like to ask if there is any architectural change that makes column updates slower than Hive 1 in Hive 3 and later versions.

       

      Thank you.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              srsok JungHyun An
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: