Unsupervised anomaly prediction method for two-stage cloud server

A technology of cloud server and prediction method, applied in neural learning methods, instruments, biological neural network models, etc., can solve problems such as difficult cloud server anomaly prediction, difficulty in building anomaly prediction model, imbalance, etc.

Pending Publication Date: 2020-11-10
SOUTH CHINA UNIV OF TECH
View PDF2 Cites 45 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] At present, researchers have proposed many anomaly prediction methods. The document "Anomaly Prediction Method, Abnormal Prediction System and Abnormal Prediction Device (CN106330852B)" proposes to record and construct corresponding prediction rules according to the system command to perform abnormal prediction. This method is not applicable to the system In complex cloud environment scenarios, there are many commands in the system layer and application layer of the cloud environment scenario, and it is difficult to predict the abnormality of the cloud server from this layer
The document "A Method and Equipment for Abnormality Prediction of Drive System (CN110426634A)" proposes to construct a state distribution map of the system based on the current response parameters and historical state of the system, and quantify the abnormal risk in the system area, so as to predict the abnormality of the system. However, There are complex dependencies between cloud server KPIs data, and they are unbalanced and unlabeled. This method is particularly difficult when constructing a state distribution map, which makes it difficult to build an anomaly prediction model.
Therefore, how to construct a method suitable for cloud server anomaly prediction is still a challenge for cloud server intelligent operation and maintenance.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unsupervised anomaly prediction method for two-stage cloud server
  • Unsupervised anomaly prediction method for two-stage cloud server
  • Unsupervised anomaly prediction method for two-stage cloud server

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0063] A two-stage cloud server unsupervised anomaly prediction method, comprising the following steps:

[0064] S1. Perform missing value processing, data formatting and data normalization processing on the collected cloud server historical KPIs data;

[0065] The missing value processing refers to missing values ​​in intervals, that is, there are no more than 5 consecutive missing values ​​in a row or a column, and the average value of the latest 24 non-missing values ​​is used to complete and repair; for continuous missing values, that is, a row or column If there are more than 5 consecutive missing values ​​in a column, the missing values ​​are removed directly;

[0066] The data formatting refers to converting the category time series into a numerical time series by enumeration for the category time series of a certain dimension;

[0067] The data normalization processing refers to normalizing the cloud server KPIs data after missing value processing and data formatting,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an unsupervised anomaly prediction method for two-stage cloud server, which is used for solving the anomaly prediction problem of a cloud server environment. The method comprises a prediction stage and an anomaly detection stage, the prediction stage is used for training a many-to-many time sequence prediction model according to preprocessed historical cloud server key performance index data, and the model is used for predicting cloud server KPIs data at the future moment; in the anomaly detection stage, a multivariable anomaly detection model is trained according to preprocessed historical cloud server KPIs data, anomaly detection is conducted on the predicted KPIs data at the future moment through the model, the anomaly probability of data points at the future moment is obtained, finally, an anomaly probability threshold value is set, and the data points with the anomaly probability threshold value larger than the threshold value are regarded as abnormal datapoints. Otherwise, the data points are normal data points, and an anomaly prediction result is obtained. The invention has the advantages of being independent of label data, wider in applicability andexcellent in performance.

Description

technical field [0001] The invention belongs to the field of computer application technology, and in particular relates to a two-stage cloud server unsupervised abnormal prediction method. Background technique [0002] Cloud server (Elastic Compute Service, ECS) is a computing service that is simple, efficient, safe and reliable, and has elastically scalable processing capabilities. It makes developers no longer need to purchase hardware separately, and only needs to host the service on the cloud server. Although cloud server hosting services have very broad prospects, cloud server providers still face many challenges, among which the availability of cloud servers ranks at the forefront. Software and hardware failures or operational errors may directly lead to cloud server downtime, resulting in losses to users. Therefore, how to effectively monitor cloud servers and make effective anomaly predictions has become an important research issue. [0003] The monitoring data of ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06N3/04G06N3/08
CPCG06N3/049G06N3/08G06N3/044G06N3/045G06F18/23213G06F18/2433G06F18/214
Inventor 刘发贵蔡木庆
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products