Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-44741

Support regex-based MetricFilter in StatsdSink

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 4.0.0
    • 4.0.0
    • Spark Core
    • Important

    Description

      Spark statsd metrics sink in the current state does not support metrics filtering option. 

      Though this option is available in the reporters it is not exposed in the statsD sink. An example of this can be looked at https://github.com/apache/spark/blob/be9ffb37585fe421705ceaa52fe49b89c50703a3/core/src/main/scala/org/apache/spark/metrics/sink/GraphiteSink.scala#L76

       

      This is a critical option to have when teams does not want all the metrics that are exposed by spark in the metrics monitoring platforms and switch to detailed metrics as and when needed. 

       

      Attachments

        Activity

          People

            ramkrish1489 rameshkrishnan muthusamy
            ramkrish1489 rameshkrishnan muthusamy
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: