Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Multi-index anomaly detection method based on neural network

An anomaly detection and neural network technology, applied in the computer field, can solve the problems of system measurement fluctuation noise, large learning overhead, etc., and achieve high prediction accuracy, scalability, and effective system behavior learning.

Active Publication Date: 2020-01-10
上海擎创信息技术有限公司
View PDF3 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The learning scheme first needs to achieve scalability, which leads to a large learning overhead
Furthermore, system metrics for real distributed applications often fluctuate due to dynamic workload or measurement noise, which requires a robust learning scheme

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-index anomaly detection method based on neural network
  • Multi-index anomaly detection method based on neural network
  • Multi-index anomaly detection method based on neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] Embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings, as figure 1 As shown, the implementation steps are as follows:

[0039] Step 1: Define the data format;

[0040]Data set D has a total of n data points and d dimensions, including time, index 1, index 2, index 3... index d; the i-th row of data can be expressed as a d-dimensional vector: x(t)=(xi1, xi2,...,xid); where xid represents a system metric, such as CPU, memory, disk I / O, or network traffic, and uses a vector of measurements as input for training a SOM; a SOM consists of a set of neurons arranged in a lattice Each neuron is assigned a different weight vector and map coordinates, the weight vector and the measurement vector have the same length, and the vector in the training data is dynamically updated according to the measurement value;

[0041] Step 2: Use SOM to train the system model, which is defined as the learning process Learning Proces...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a multi-index anomaly detection method based on a neural network. The multi-index anomaly detection method comprises the following specific steps: 1, defining a data format; 2,carrying out model training on the system by utilizing SOM, and defining the system as a learning process; 3, performing anomaly detection on the input data, and defining the anomaly detection as a mapping process; and 4, when the model is mapped to be abnormal, carrying out root cause positioning. According to the multi-index anomaly detection method, the induction behavior model can be used forpredicting the unknown performance abnormality and providing an abnormality reason prompt, and the model can obtain higher prediction precision in a benchmark test result; the high-dimensional inputspace is mapped into the low-dimensional map space by using the SOM; and meanwhile, the topological property of the original input space is reserved, so that expandability and effective system behavior learning can be realized.

Description

technical field [0001] The invention relates to a technology in the computer field, in particular to a neural network-based multi-indicator anomaly detection method. Background technique [0002] An outlier is a data point that deviates sufficiently from other points to warrant suspicion of another mechanism. Anomaly detection methods have been used in various application domains, such as intrusion detection, financial fraud, medical diagnosis, law enforcement, and natural sciences. The most common outlier detection methods involve the use of distance-based methods, and despite their age, these methods have become the most popular and provide robust results. [0003] A particularly difficult case of anomaly detection is high-dimensional anomaly detection, where outliers are hidden by irrelevant attributes. In high-dimensional anomaly detection, many different methods such as feature bagging, high-contrast methods, statistical subspace selection, and spectral methods are us...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06N3/08
CPCG06N3/088Y02P90/30
Inventor 葛晓波杨辰殷传旺
Owner 上海擎创信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products