Method and device for detecting log sequence abnormity and computer storage medium

A log and sequence technology, applied in computer parts, computing, unstructured text data retrieval, etc., can solve the loss of text semantic information, regardless of log execution order, log parser robustness and accuracy affect anomaly detection performance and other problems, to achieve the best detection effect and the effect of improving the ability

Pending Publication Date: 2021-09-17
HARBIN INST OF TECH SHENZHEN GRADUATE SCHOOL
View PDF3 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the diversity of log formats in different systems, log parsers are not suitable for all log types
Furthermore, the robustness and accuracy of the log parser affects the performance of anomaly detection
Worse, usage of log parsers leads to loss of textual semantic information
[0004] (2) The method based on the event c

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for detecting log sequence abnormity and computer storage medium
  • Method and device for detecting log sequence abnormity and computer storage medium
  • Method and device for detecting log sequence abnormity and computer storage medium

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0053] In order to further describe the technical solution of the present invention in detail, this embodiment is implemented on the premise of the technical solution of the present invention, and provides a detailed implementation manner and specific steps.

[0054] Embodiments of the present invention are directed to a method, device, and computer storage medium for detecting log sequence anomalies, refer to Figure 1-4 shown, figure 2 It is a schematic flowchart of a method for detecting log sequence anomaly according to an embodiment of the present invention, and the specific implementation steps are:

[0055] S01. Data collection: collect original log sequence data from a data source, wherein the data source includes but is not limited to a system server, an application server, and a database.

[0056] S02. Data storage: store the collected log sequence data in a designated storage medium. The storage medium includes two parts, online and offline. The data may not be st...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method and a device for detecting log sequence abnormity and a computer storage medium. The method comprises the following steps: collecting original log sequence data from a data source; sequentially extracting semantic information of each layer according to a hierarchical structure of a log sequence in the log sequence data, and generating a semantic vector of a fixed dimension of each layer; and calculating probability distribution of the log sequence by utilizing a SoftMax function according to the semantic vector of the log sequence, and selecting a result corresponding to the maximum conditional probability as an output category. According to the invention, richer semantic features can be extracted from words, logs and log sequences, so that the device can learn more accurate hierarchical semantic expressions, a better detection effect is achieved, and the capability of detecting three log sequence anomalies is further improved.

Description

technical field [0001] The invention relates to the technical field of data mining, and in particular, to a method, a device and a computer storage medium for detecting log sequence anomalies. Background technique [0002] A large number of system logs are usually generated during the operation of modern systems, which record the operating information of the system in the form of text, and map the important activity states of the system at different key points. Log anomaly detection is helpful for anomaly location and cause analysis, thereby reducing error time and ensuring the normal operation of the system. The logs are arranged in order of execution time, forming a log sequence. Exception log sequences may not contain exception logs, as there may be cases where all individual logs are normal, but abnormal execution order or incomplete execution patterns of log sequences cause exceptions. Therefore, logs have context, and we need to detect log anomalies from the perspect...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/35G06F40/30G06F40/289G06F40/284G06F40/216G06K9/62G06N3/04G06F16/18
CPCG06F16/353G06F40/30G06F40/289G06F40/284G06F40/216G06F16/1815G06N3/044G06F18/2415
Inventor 张春慨
Owner HARBIN INST OF TECH SHENZHEN GRADUATE SCHOOL
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap