Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-8327

Potential out-of-memory in MessagingMetricsProcessorService

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 4.1.0
    • Fix Version/s: 4.2.0
    • Component/s: None
    • Labels:
      None
    • Release Notes:
      Hide
      Add property "metrics.processor.queue.size" with default value 20000 to limit the maximum size of a queue where metrics processor temporarily stores newly fetched metrics in memory before persisting them. Add property "metrics.processor.max.delay.ms" with default value 3000 milliseconds to specify the maximum delay allowed between the latest metrics timestamp and the time when it is processed. The larger this property is, Metrics Processor gets to sleep more often between fetching each batch of metrics but the delay between metrics emission and processing also increases. Deprecated property "metrics.messaging.fetcher.limit"
      Show
      Add property "metrics.processor.queue.size" with default value 20000 to limit the maximum size of a queue where metrics processor temporarily stores newly fetched metrics in memory before persisting them. Add property "metrics.processor.max.delay.ms" with default value 3000 milliseconds to specify the maximum delay allowed between the latest metrics timestamp and the time when it is processed. The larger this property is, Metrics Processor gets to sleep more often between fetching each batch of metrics but the delay between metrics emission and processing also increases. Deprecated property "metrics.messaging.fetcher.limit"
    • Rank:
      1|hzztxz:

      Description

      Currently, MessagingMetricsProcessorService keeps adding new metrics to a queue before persisting them. There is a risk of out-of-memory. Need to add a threshold for persisting.

        Attachments

          Activity

            People

            • Assignee:
              mao Chengfeng Mao
              Reporter:
              mao Chengfeng Mao
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: