Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-31516

Non-existed metric hiveClientCalls.count of CodeGenerator in Monitoring Doc

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • Documentation, Spark Core
    • None

    Description

      There is a duplicated `hiveClientCalls.count` metric in both `namespace=HiveExternalCatalog` and  `namespace=CodeGenerator` bullet lists of Spark Monitoring doc, but there is only one inside object HiveCatalogMetrics in source code.

      • namespace=HiveExternalCatalog
        • note:: these metrics are conditional to a configuration parameter: spark.metrics.staticSources.enabled (default is true)
        • fileCacheHits.count
        • filesDiscovered.count
        • hiveClientCalls.count
        • parallelListingJobCount.count
        • partitionsFetched.count
      • namespace=CodeGenerator
        • note:: these metrics are conditional to a configuration parameter: spark.metrics.staticSources.enabled (default is true)
        • compilationTime (histogram)
        • generatedClassSize (histogram)
        • generatedMethodSize (histogram)
        • hiveClientCalls.count
        • sourceCodeSize (histogram)

       

       

      Attachments

        Issue Links

          Activity

            People

              zhangw ZHANG Wei
              zhangw ZHANG Wei
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: