Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-6147

Thrift profile includes counters not directly shown in text profile

    XMLWordPrintableJSON

Details

    Description

      InactiveTotalTime and TotalTime show up in the thrift profiles but aren't explicitly shown in the Impala pretty-printed text profile.

      TotalTime and InactiveTotalTime are handled specially - they are factored into the timings printed in the header of each profile section, e.g HDFS_SCAN_NODE (id=5):(Total: 10.213ms, non-child: 10.213ms, % non-child: 100.00%). InactiveTotalTime is non-zero only for exchange nodes.

      Impala does a calculation involving those two counters: https://github.com/apache/incubator-impala/blob/7866eec5bdcbf9194a4aad2c87c354cbaad7b802/be/src/util/runtime-profile.cc#L362 then prints the result in the text profile: https://github.com/apache/incubator-impala/blob/7866eec5bdcbf9194a4aad2c87c354cbaad7b802/be/src/util/runtime-profile.cc#L625

      We should include/exclude things from the thrift profile that prevent consumers of the thrift profile from presenting identical information to the pretty-printed text profiles.

      Attachments

        Activity

          People

            tarmstrong Tim Armstrong
            tarmstrong Tim Armstrong
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: