Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-25452

Hive job fails while closing reducer output - Unable to rename

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.1.0
    • None
    • Query Processor
    • None

    Description

      I have observed similar issue for Hive on LLAP:

      Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to rename output from: 
      abfs://<redacted>/tmp/hive/root/277a283f-9d32-4525-b35f-03551c6a364e/hive_2021-08-15_20-22-24_848_2416200416962826887-27/-mr-10001/.hive-staging_hive_2021-08-15_20-22-24_848_2416200416962826887-27/_task_tmp.-ext-10002/_tmp.000000_3 to: 
      abfs://<redacted>/tmp/hive/root/277a283f-9d32-4525-b35f-03551c6a364e/hive_2021-08-15_20-22-24_848_2416200416962826887-27/-mr-10001/.hive-staging_hive_2021-08-15_20-22-24_848_2416200416962826887-27/_tmp.-ext-10002/000000_3
       at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.commitOneOutPath(FileSinkOperator.java:272)
       at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.commit(FileSinkOperator.java:236)
       at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.access$400(FileSinkOperator.java:168)
       at org.apache.hadoop.hive.ql.exec.FileSinkOperator.closeOp(FileSinkOperator.java:1331)
       at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:732)
       at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:756)
       at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:756)
       at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.close(ReduceRecordProcessor.java:383) ... 16 more
      

      Attachments

        Issue Links

          Activity

            People

              gupta.nikhil0007 Nikhil Gupta
              gupta.nikhil0007 Nikhil Gupta
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: