Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-3393

Add Oozie instrumentation delayed metric in CoordMaterializeTriggerService

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 5.2.0
    • coordinator
    • None

    Description

      We have multiple Oozie scheduled clusters. The problem that is currently encountered is that some materialize queues are too late to process during the peak hours of the scheduled tasks. We need to get the metrics of the delay queue for alarm monitoring and adjust the configuration to optimize.
      Currently we have added metrics for queue size and latency in Oozie CoordMaterializeTriggerService class, in order to reflect the general trend of current scheduling.

      Attachments

        1. oozie-3393-1.patch
          5 kB
          Junfan Zhang
        2. oozie-3393-2.patch
          5 kB
          Junfan Zhang
        3. oozie-instrumentation-1.log
          0.4 kB
          Junfan Zhang
        4. oozie-3393-3.patch
          8 kB
          Junfan Zhang
        5. oozie-3393-4.patch
          9 kB
          Junfan Zhang
        6. oozie-3393-5.patch
          9 kB
          Junfan Zhang
        7. amend-oozie-3393-1.patch
          3 kB
          Junfan Zhang

        Activity

          People

            zuston Junfan Zhang
            zuston Junfan Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: