Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-23206 Additional Memory Tuning Metrics
  3. SPARK-23432

Expose executor memory metrics in the web UI for executors

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.1.0
    • 3.1.0
    • Spark Core
    • None

    Description

      Add the new memory metrics (jvmUsedMemory, executionMemory, storageMemory, and unifiedMemory, etc.) to the executors tab, in the summary and for each executor.

      This is a subtask for SPARK-23206. Please refer to the design doc for that ticket for more details.

      Attachments

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. SPARK-33906 SPARK UI Executors page stuck when ExecutorSummary.peakMemoryMetrics is unset

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          links to

          Pull request #30186 [Github] Pull Request #30186 (warrenzhu25)

          Activity

            People

              warrenzhu25 Zhongwei Zhu
              elu Edward Lu
              Votes:
              1 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: