Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17718 Hive on Spark Debugging Improvements
  3. HIVE-13517

Hive logs in Spark Executor and Driver should show thread-id.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.2.1, 2.0.0
    • None
    • Spark
    • None

    Description

      In Spark, there might be more than one task running in one executor. Similarly, there may be more than one thread running in Driver.

      This makes debugging through the logs a nightmare. It would be great if there could be thread-ids in the logs.

      Attachments

        1. executor-driver-log.PNG
          69 kB
          liyunzhang
        2. HIVE-13517.1.patch
          4 kB
          Sahil Takiar
        3. HIVE-13517.2.patch
          5 kB
          Sahil Takiar

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-20161 Default log4j properties file should print thread-id in ConversionPattern

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              szehon Szehon Ho
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated: