Log detection method and system

A detection method and detection system technology, applied in the computer field, can solve problems such as unsuitable log anomaly detection, and achieve accurate prediction results

Inactive Publication Date: 2012-12-19
INST OF INFORMATION ENG CHINESE ACAD OF SCI
View PDF2 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

But as discussed above, neither of these methods is suitable for log anomaly detection

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log detection method and system
  • Log detection method and system
  • Log detection method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] The principles and features of the present invention are described below in conjunction with the accompanying drawings, and the examples given are only used to explain the present invention, and are not intended to limit the scope of the present invention.

[0056] figure 1 It is a flow chart of the log detection method in the embodiment of the present invention. Such as figure 1 As shown, in this embodiment, the flow of the log detection method may include the following steps:

[0057] Step 11, using a preset grammar compression algorithm to compress the log data to be detected and the training set data;

[0058] Among them, the compression algorithm is a grammar compression algorithm. The core idea of ​​grammar compression is to use each character in the string to be detected as a non-terminal symbol, and then use grammar simplification rules to merge productions, and finally generate a production set. Grammar compression avoids problems such as complex parameter s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a log detection method and a system. The log detection method comprises the following steps: using a preset grammar compression algorithm to compress the data of a log to be detected and the data of a training set; calculating the information density of the compressed data; arranging the data of the log to be detected in a descending order in accordance with the information density, wherein the front arranged n log data are abnormal data, and n is a preset number of the abnormal data. According to the log detection method and the system, the grammar compression is introduced to the log detection, so that various problems caused by general compression are avoided; moreover, the continuity of the log data is used, and the information density is used for judge whether the log has an exception, so that the log detection method and the system not only can avoid defects caused by a traditional design and the Markov method, but also is simple and effective, and accurate in predication, and complex parameters do not need to be set.

Description

technical field [0001] The invention relates to the field of computers, in particular to a log detection method and system. Background technique [0002] As the log capacity increases, it becomes more important for debugging and diagnosis to find out the parts worthy of attention through anomaly detection from highly redundant logs. Research on anomaly detection has a long history. Anomaly detection algorithms are generally used in attack detection and network security. Most of the existing anomaly detection mechanisms are based on statistical models and Markov models, but they all have their own problems. [0003] An anomaly detection system is divided into two phases: in the training phase, a baseline model is established for normal samples; in the detection phase, the difference between the candidate samples and the baseline model is evaluated. The basic technical routes of anomaly detection include statistics, machine learning and data mining. Statistical models and ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/00H03M7/30
Inventor 王楠周薇韩冀中
Owner INST OF INFORMATION ENG CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap