Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-24637

Make Tez progress log interval configurable

    XMLWordPrintableJSON

Details

    Description

      In case of hive on MR we can configure how often the progress log is updated in the client side with the parameter https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java#L2041-L2050 while in case of Hive on Tez this value is hard coded hereĀ https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/monitoring/RenderStrategy.java#L42. The default value in Tez is also significantly shorter than that of MR (6 VS 3 S) meaning for longer queries the client log can get very long.

      Attachments

        Issue Links

          Activity

            People

              johang Johan Gustavsson
              johang Johan Gustavsson
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 40m
                  1h 40m