Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-10507

Workaround for sporadic TPC-DS testdata insert error

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Abandoned
    • Impala 3.4.0
    • None
    • Infrastructure
    • None
    • ghx-label-3

    Description

      A TPC-DS insert statement generated from testdata/datasets/tpcds/tpcds_schema_template.sql fails with Tez errors trying to allocate space. This Jira is to woraround the error in the test.

      Statment:

      insert overwrite table store_sales partition(ss_sold_date_sk)
      select ... from store_sales_unpartitioned
      WHERE 2451272 <= ss_sold_date_sk and ss_sold_date_sk < 2451728
      distribute by ss_sold_date_sk

      Error:

      Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /test-warehouse/tpcds.store_sales/.hive-staging_hive_2021-01-04_11-08-20_683_8822236846070344153-996/_task_tmp.-ext-10002/ss_sold_date_sk=2451574/_tmp.000000_1 could only be written to 0 of the 1 minReplication nodes. There are 3 datanode(s) running and 3 node(s) are excluded in this operation.

      Attachments

        Issue Links

          Activity

            People

              kdeschle Kurt Deschler
              kdeschle Kurt Deschler
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: