System log classification method

A system log and classification model technology, applied in the direction of file system type, file system, text database clustering/classification, etc., can solve the problems of classification accuracy and time efficiency decline, accuracy and time efficiency are not high, and achieve convenient positioning Or predict, protect the effect of sensitive information

Active Publication Date: 2020-12-29
INST OF COMPUTING TECH CHINESE ACAD OF SCI
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the accuracy and time efficiency of these classification methods are generally not high, especially when classifying system logs of large data sets, these methods have a significant decline in classification accuracy and time efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System log classification method
  • System log classification method
  • System log classification method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below through specific embodiments in conjunction with the accompanying drawings. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0026] Aiming at the problems of low timeliness and low accuracy in current system log classification methods, the present invention introduces convolutional neural network technology to construct a system log classification model, and uses the model to classify system logs. The reason for using convolutional neural network technology is that it is suitable for processing complex high-dimensional data (that is, suitable for large data scenarios). The basic principle and training process of convolutional neural network will be described first.

[0027] The convolutional neural network i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method for extracting feature vectors from system logs, a method for constructing a system log classification model and a system log classification method. The method of extracting feature vectors includes: for each category, calculate the semantic similarity between the category keywords and the system log, select some similarities as the feature vector of the system log under this category; combine the feature vectors of the system log under all categories to get the feature vector of the system log. The method of constructing the model utilizes the method described above to extract the feature vector of the training data set and use it as the input of the convolutional neural network to train the model. The system log classification method uses the above method to extract the feature vector of the system log, and obtains the classification result through the model. The invention can realize system log classification with high accuracy and high timeliness.

Description

technical field [0001] The invention relates to the field of log processing and analysis, in particular to system log classification technology. Background technique [0002] System logs are used to record hardware, software, and system problems in computer systems, and to monitor events that occur in the system. System logs in a broad sense include system RAS logs and system security audit logs, etc. Administrators can check the system status at any time by viewing system logs, check the cause of errors, or look for traces left by attackers when they are attacked. [0003] When the number of system logs is increasing day by day, it is necessary to sort out different types of system logs. By classifying system logs, system administrators can continuously observe the health status of the system, locate root faults, and perform task scheduling and performance optimization. Existing system log classification methods include density-based methods, cluster analysis-based method...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/18G06F16/35G06N3/04
CPCG06F16/1815G06F16/35G06N3/048G06N3/045
Inventor 程杰超任睿殷岩詹剑锋王磊
Owner INST OF COMPUTING TECH CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products