Processing Time Threshold Monitoring for Anomaly Detection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

In high-volume online service environments, conventional periodic processing of events for generating reports can lead to significant delays in detecting issues due to the extensive time required for processing large volumes of data, resulting in potential delays in identifying and addressing traffic changes or problems.

Innovation Solution

A method and system that estimate processing time for operations, calculate threshold run times, and send notifications when processing times exceed or fall below predetermined thresholds, enabling timely identification of anomalous processing and resource allocation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If periodic processing of events is used to generate reports, then comprehensive event analysis is achieved, but detection time for issues increases significantly

Engineering Contradiction:

Improveevent analysis completenessVSAvoidissue detection time

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by continuously monitoring event processing times in real-time and comparing them against threshold values, rather than waiting for periodic report generation. This allows early detection of anomalous processing conditions before they result in significant delays.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system implements feedback mechanisms by continuously measuring actual processing times, comparing them against expected thresholds, and triggering notifications when anomalies are detected. This closed-loop approach enables dynamic response to changing conditions without requiring comprehensive periodic reprocessing.

Inventive Principle:

Principle #23Feedback

2Speed

If real-time monitoring of processing time is implemented, then issue detection speed improves, but system complexity increases

Engineering Contradiction:

Improveissue detection speedVSAvoidmonitoring system complexity

Core Design Contradiction:

SpeedVSDevice complexity

Solution Approach 1:

The system performs self-service by using its existing event processing infrastructure to monitor its own performance characteristics. The same processing systems that handle events also measure and report their processing times, eliminating the need for separate dedicated monitoring hardware or systems.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The event processing system is made multi-functional by having it simultaneously perform event processing, processing time measurement, threshold comparison, and anomaly notification. This consolidates multiple functions into a single system, reducing overall complexity despite enabling real-time monitoring.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS8856598B1Help center alerts by using metadata and offering multiple alert notification channels

Publication Date: 2014.10.07 GOOGLE LLC

AI summary

A system and machine-implemented method relating to identifying anomalous events by estimating a processing time for an operation, estimating a processing time for an operation; calculating a maximum threshold time based on the estimated processing time for indicating anomalous processing of the operation, periodically determining during processing of the operation an amount of processing time used to perform the operation; and sending a notification to a user indicating an anomalous run of the operation has occurred if the determined amount of processing time exceeds the maximum threshold time.