Supercharge Your Innovation With Domain-Expert AI Agents!

Log classification management method and system based on support vector machine

A technology of support vector machine and classification management, applied in the field of log classification management method and system based on support vector machine, can solve the problems such as the tedious workload of operation and maintenance and R&D personnel, and achieve reliable design principle, wide application prospect and simple structure Effect

Inactive Publication Date: 2020-10-02
SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Aiming at the above-mentioned cluster system in the prior art that generates a large number of log files, which brings cumbersome workload to operation and maintenance and R&D personnel, the present invention provides a log classification management method and system based on support vector machines to solve the above-mentioned technical problems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log classification management method and system based on support vector machine
  • Log classification management method and system based on support vector machine
  • Log classification management method and system based on support vector machine

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0066] Such as figure 1 As shown, the present invention provides a kind of log classification management method based on support vector machine, comprises the following steps:

[0067] S1. Obtain the original system log, and analyze the original system log to obtain structured log data;

[0068] S2. Perform feature extraction on the structured log data, extract a set of digital feature vectors for each log, and all digital feature vectors form a feature data set;

[0069] S3. Perform sample labeling on the extracted feature data set, and divide it into a training set and a test set according to a set ratio;

[0070] S4. Obtain the support vector machine model, train the support vector machine model through the training set, and then verify the support vector machine model through the test set;

[0071] S5. The trained and verified support vector machine model classifies the newly generated logs, and sets corresponding management policies for each category of logs.

Embodiment 2

[0073] Such as figure 2 As shown, the present invention provides a kind of log classification management method based on support vector machine, comprises the following steps:

[0074] S1. Obtain the original system log, and analyze the original system log to obtain structured log data; the specific steps are as follows:

[0075] S11. Obtain the original system log;

[0076] S12. Analyze the original system log by the logkey method to obtain constant structure data and variable structure data; the constant structure data includes system program source code messages, and the variable structure data includes timestamps or parameter values;

[0077] S2. Perform feature extraction on the structured log data, extract a set of digital feature vectors for each log, and all digital feature vectors form a feature data set; the specific steps are as follows:

[0078] S21. Perform feature extraction on structured log data, and extract message count vector,

[0079] Process state vect...

Embodiment 3

[0094] Such as image 3 As shown, the present invention provides a kind of log classification management system based on support vector machine, comprising:

[0095] The log parsing module 1 is used to obtain the original system log, and analyze the original system log to obtain structured log data; the log parsing module 1 includes:

[0096] Log classification module 1.1, used to obtain original system logs;

[0097] The log structure analysis unit 1.2 is used to analyze the original system log by the logkey method to obtain constant structure data and variable structure data; the constant structure data includes system program source code messages, and the variable structure data includes timestamps or parameter values ;

[0098] The log feature extraction module 2 is used to extract the features of the structured log data, extract a set of digital feature vectors for each log, and all digital feature vectors form a feature data set; the log feature extraction module 2 inc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a log classification management method and system based on a support vector machine, and the method comprises the following steps: S1, obtaining an original system log, and analyzing the original system log to obtain structured log data; s2, performing feature extraction on the structured log data, extracting a group of digital feature vectors for each log, and forming a feature data set by all the digital feature vectors; s3, performing sample labeling on the extracted feature data set, and dividing the feature data set into a training set and a test set according to aset proportion; s4, obtaining a support vector machine model, training the support vector machine model through the training set, and verifying the support vector machine model through the test set; and S5, classifying newly generated logs by the trained and verified support vector machine model, and adopting a corresponding management strategy for each class of logs.

Description

technical field [0001] The invention belongs to the technical field of log management, and in particular relates to a log classification management method and system based on a support vector machine. Background technique [0002] Log: Network devices, systems, and service programs, etc., will generate an event record called a log during operation; each line of log records the description of related operations such as date, time, user, and action. [0003] Support Vector Machine (SVM): Support Vector Machine is a machine learning method based on the principle of statistical learning and structural risk minimization. It also has excellent learning ability in the case of fewer samples. [0004] During the scheduled operation of the storage cluster, as the amount of data access increases, the log files generated by the cluster system gradually begin to explode over time. Operation and maintenance personnel and R&D personnel generally understand and optimize the system based on...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/35G06K9/62
CPCG06F16/35G06F18/2411G06F18/214
Inventor 庆隆阳
Owner SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More