Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17718 Hive on Spark Debugging Improvements
  3. HIVE-18378

Explain plan should show if a Map/Reduce Work is being cached

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Spark
    • None

    Description

      It would be nice if the explain plan showed what MapWork / ReduceWork objects are being cached by Spark.

      The CombineEquivalentWorkResolver is the only code that triggers Spark cache-ing, so we should be able to modify it so that it displays if a work object will be cached or not.

      Attachments

        1. HIVE-18378.1.patch
          3 kB
          Sahil Takiar

        Activity

          People

            kellyzly liyunzhang
            stakiar Sahil Takiar
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated: