Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-25

Add metrics

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.6.0
    • 0.7.0
    • container, kafka, kv, metrics, yarn
    • None

    Description

      The latest refactor dropped a bunch of metrics. We need to re-add them.

      Classes that need metrics:

      • Add metrics to SamzaContainer/SamzaContainerMetrics
      • Add metrics to TaskInstance/TaskInstanceMetrics
      • Add metrics to TaskStorageManager
      • Add metrics to MessageChooser
      • Add metrics to DefaultChooser
      • Add metrics to SystemConsumers
      • Add metrics to SystemProducers
      • Add metrics to KafkaSystemProducer
      • Add metrics to KafkaSystemConsumer
      • Add metrics to BrokerProxy
      • Add metrics to CachedStore
      • Add metrics to LoggedStore
      • Add metrics to KeyValueStorageEngine
      • Add metrics to LevelDbKeyValueStore

      We definitely need msgs/sec, bytes/sec at both the container and task level. We also need reads/sec writes/sec on the stores. A lot more, as well.

      Attachments

        1. SAMZA-25.2.patch
          89 kB
          Chris Riccomini
        2. SAMZA-25.1.patch
          81 kB
          Chris Riccomini
        3. SAMZA-25.0.patch
          5 kB
          Chris Riccomini
        4. jmx-metrics.png
          717 kB
          Chris Riccomini

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            criccomini Chris Riccomini
            criccomini Chris Riccomini
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment