Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-22549

RS deduplication should not merge final aggregation without keys

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • Physical Optimizer
    • None

    Description

      This may lead to performance degradation. For instance, this can happen for the following query:

      set hive.support.concurrency=true;
set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;

EXPLAIN
CREATE TABLE x STORED AS ORC TBLPROPERTIES('transactional'='true') AS
SELECT * FROM SRC x CLUSTER BY x.key;

      Attachments

        1. HIVE-22549.patch
          11 kB
          jcamachorodriguez

        Issue Links

          is fixed by

          Bug - A problem which impairs or prevents the functions of the product. HIVE-22538 RS deduplication does not always enforce hive.optimize.reducededuplication.min.reducer

          • Major - Major loss of function.
          • Closed

          Activity

            People

              jcamacho Jesús Camacho Rodríguez
              jcamacho Jesús Camacho Rodríguez
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: