Computer System Anomaly Detection Using Metric-to-Image Modeling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing anomaly detection methods in computing systems are resource-intensive, time-consuming, and unsuitable for real-time detection, particularly in complex systems with numerous parameters across hardware, software, and application layers, lacking explainability and requiring high computational resources.
Innovation Solution
A deep learning-based method transforms system metrics from all layers into images for anomaly detection, using image processing techniques to efficiently identify performance abnormalities and determine the causing agent, enabling real-time monitoring and self-healing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If traditional rule-based techniques are used for anomaly detection, then explainability is improved, but computational resource consumption increases and real-time detection capability deteriorates
Solution Approach 1:
The patent segments the anomaly detection process into two distinct phases: an offline training phase where the deep learning model is trained using historical data, and an online detection phase where the trained model is deployed for real-time anomaly detection. This segmentation allows the computationally intensive training to be performed once offline, while the online phase requires minimal computational resources for real-time operation, thus resolving the contradiction between explainability and computational resource consumption.
2Measurement precision
If deep learning methods are used for anomaly detection, then detection accuracy is improved, but explainability deteriorates
Solution Approach 1:
The patent implements feedback mechanisms where the deep learning model's predictions are continuously monitored and evaluated. The model processes system metrics and performance data, generates anomaly predictions, and these predictions are fed back into the system for validation. This feedback loop allows the system to maintain high detection accuracy while providing explainable insights through the continuous evaluation and interpretation of model predictions, thus resolving the contradiction between detection accuracy and explainability.
3Device complexity
If rule-based techniques are used for bottleneck analysis, then system complexity is reduced, but detection capability deteriorates
Solution Approach 1:
The patent creates a virtual copy of the system's operational state by collecting and processing system metrics, performance data, and logs into a structured data representation. This copied data model allows the deep learning algorithm to analyze system behavior without directly complicating the actual system architecture. The virtual data copy enables sophisticated anomaly detection while keeping the physical system relatively simple, thus resolving the contradiction between system complexity and detection capability.
4Use of energy by moving object
If traditional machine learning approaches are used, then computational resource consumption is reduced, but detection accuracy deteriorates
Solution Approach 1:
The patent performs preliminary action by training the deep learning model offline using extensive historical data before deployment. During this offline training phase, the model learns complex patterns and relationships in the data, achieving high detection accuracy. Once trained, the model is deployed for online detection where it requires minimal computational resources, thus resolving the contradiction between computational resource consumption and detection accuracy by performing the resource-intensive work in advance.
Data Source
Figure 1~2
Figure 3~4
Figure 5~6
AI summary
The invention concerns a method of detecting abnormal behavior of a computer system comprising an application layer, a software layer and a hardware layer; the method being carried out by a processing unit and comprising the steps of: - collecting metrics relating to at least one of application layer, software layer and hardware layer, - normalizing every metric into a range of an image coding, - creating an image from at least all normalized metrics, and - applying a data science model such as a deep learning model on the created image to detect abnormal behavior.