Log anomaly detection method

A detection method and anomaly detection technology, applied in the field of data processing, can solve the problem of low interpretability of logs, achieve the effect of solving anomalies, enhancing interpretability, and ensuring efficient and stable operation

Active Publication Date: 2020-02-04
北京云集智造科技有限公司
View PDF11 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Aiming at the deficiencies of the prior art, the present invention provides a log anomaly detection ...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log anomaly detection method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention are clearly and completely described. Obviously, the described embodiments are part of the embodiments of the present invention, not all of them. example. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0053] The embodiment of the present application provides a log anomaly detection method, which solves the technical problem of low interpretability when detecting log anomalies in the prior art, and improves the interpretability when detecting log anomalies.

[0054] The technical solution of the embodiment of the present application is to solve the above-mentioned technical problems, and the general idea is as follows:

[0055]T...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a log anomaly detection method, and relates to the field of data processing. The method comprises the following steps: acquiring historical log data and real-time log data; preprocessing the historical log data; obtaining an initial data set and a stream data set based on the historical log data set; obtaining an initial log mode library based on the initial data set; updating the initial log mode library to obtain a log mode library; acquiring a mode library mode vector based on the log mode library; obtaining a streaming data mode vector based on the streaming data set; processing the historical log data set based on the mode library mode vector to obtain a log data mode; obtaining a dependency relationship library based on the two mode vectors; obtaining a threshold of anomaly detection based on the two mode vectors; preprocessing the real-time log data; and respectively detecting a real-time log data set based on the log data mode, the threshold value, the log mode library and the dependency relationship library. According to the method, the interpretability is relatively high when the log abnormal condition is detected.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a log anomaly detection method. Background technique [0002] With the continuous development of science and technology, computer applications are playing an increasingly important role in people's production and life. The log is an important carrier for recording the operating status and events of the computer system. It can record the system status and important events at various key points to help debug system failures and perform root cause analysis. Therefore, the log is an excellent source of information for online monitoring and anomaly detection. By detecting abnormalities in system logs, actionable information can be provided at critical moments to ensure efficient and stable operation of the system. [0003] The method for detecting log anomalies in the prior art is generally as follows: firstly extract the log key of the log data based on the word frequency or...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F11/30
CPCG06F11/3072
Inventor 沈国鹏朱品燕
Owner 北京云集智造科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products