Details
-
Bug
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
Impala 4.2.0
-
ghx-label-7
Description
When running with MT_DOP>0, EXPLAIN_LEVEL=VERBOSE will produce broken explain string on fragment consuming input from join build fragment.
| F00:PLAN FRAGMENT [RANDOM] hosts=2 instances=2 | | Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB | | Per-Instance Resources: mem-estimate=67.58MB mem-reservation=42.00MB thread-reservation=1 | | DATASTREAM SINK [FRAGMENT=F03, EXCHANGE=11, HASH(i_class)] | | | mem-estimate=1.58MB mem-reservation=0B thread-reservation=0 | | 05:AGGREGATE [STREAMING] | | | output: sum(ws_ext_sales_price) | | | group by: i_item_id, i_item_desc, i_category, i_class, i_current_price | | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 | | | tuple-ids=3 row-size=198B cardinality=215.82K | | | in pipelines: 00(GETNEXT) | | | | | 04:HASH JOIN [INNER JOIN, BROADCAST] | | | hash-table-id=00 | | | hash predicates: ws_sold_date_sk = d_date_sk | | | fk/pk conjuncts: ws_sold_date_sk = d_date_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 | | | tuple-ids=0,1,2 row-size=232B cardinality=215.82K | | | in pipelines: 00(GETNEXT), 02(OPEN) | | | | | F05:PLAN FRAGMENT [RANDOM] hosts=2 instances=2 | | Per-Instance Resources: mem-estimate=8.96MB mem-reservation=8.75MB thread-reservation=1 runtime-filters-memory=1.00MB | | JOIN BUILD | | | join-table-id=00 plan-id=01 cohort-id=01 | | | build expressions: d_date_sk | | | runtime filters: RF000[bloom] <- d_date_sk | | | mem-estimate=7.75MB mem-reservation=7.75MB spill-buffer=64.00KB thread-reservation=0 | | | | | 10:EXCHANGE [BROADCAST] | | mem-estimate=215.48KB mem-reservation=0B thread-reservation=0 | | tuple-ids=2 row-size=26B cardinality=7.30K | | in pipelines: 02(GETNEXT) | | | | | 03:HASH JOIN [INNER JOIN, BROADCAST] | | | hash-table-id=01 | | | hash predicates: ws_item_sk = i_item_sk | | | fk/pk conjuncts: ws_item_sk = i_item_sk | | | mem-estimate=0B mem-reservation=0B spill-buffer=128.00KB thread-reservation=0 | | | tuple-ids=0,1 row-size=206B cardinality=215.82K | | | in pipelines: 00(GETNEXT), 01(OPEN) | | | | | F06:PLAN FRAGMENT [RANDOM] hosts=2 instances=2 | | Per-Instance Resources: mem-estimate=13.67MB mem-reservation=12.50MB thread-reservation=1 runtime-filters-memory=1.00MB | | JOIN BUILD | | | join-table-id=01 plan-id=02 cohort-id=01 | | | build expressions: i_item_sk | | | runtime filters: RF002[bloom] <- i_item_sk | | | mem-estimate=11.50MB mem-reservation=11.50MB spill-buffer=128.00KB thread-reservation=0 | | | | | 09:EXCHANGE [BROADCAST] | | mem-estimate=1.17MB mem-reservation=0B thread-reservation=0 | | tuple-ids=1 row-size=190B cardinality=5.40K | | in pipelines: 01(GETNEXT) | | | | | 00:SCAN HDFS [tpcds_parquet.web_sales, RANDOM] | | HDFS partitions=1/1 files=2 size=45.09MB | | runtime filters: RF000[bloom] -> ws_sold_date_sk, RF002[bloom] -> ws_item_sk | | stored statistics: | | table: rows=719.38K size=45.09MB | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=644.77K | | file formats: [PARQUET] | | mem-estimate=32.00MB mem-reservation=8.00MB thread-reservation=0 | | tuple-ids=0 row-size=16B cardinality=719.38K | | in pipelines: 00(GETNEXT) |
F00 should not print F05 and F06 within it. Attached is the full explain output.