Online log analysis method

An analysis method and log technology, which is applied in the high-performance network field, can solve problems such as inability to log online analysis, and achieve the effect of reducing cost of ownership and improving behavior

Inactive Publication Date: 2010-11-17
INST OF COMPUTING TECH CHINESE ACAD OF SCI
View PDF4 Cites 68 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The purpose of the present invention is to overcome the defect that the prior art cannot do online analysis to the log, thereby providing a kind of online log analysis method, comprising:

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Online log analysis method
  • Online log analysis method
  • Online log analysis method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0059] The present invention will be described below in conjunction with the accompanying drawings and specific embodiments.

[0060] Such as figure 1 As shown, in an existing cluster system, each node is connected to each other through a network, each node is a computer system working independently, and each of these nodes will generate corresponding system log files. In the present invention, these nodes in the cluster system that generate system log files are called data nodes (data nodes), which are represented by numeral 1.

[0061] On the basis of the above-mentioned cluster system, the online log analysis system of the present invention includes a log agent A (Log agent), a log server S (Log Server) and a proactive management system P (proactive management system), wherein the log agent A is installed in the cluster On each data node 1 in the system, its function is to collect the log files of the data node where it is located. The log server S is mainly used to reali...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an online log analysis method, which comprises the following steps of: acquiring a log file from each node of a cluster system on line; defining an event sequence and an event correlation rule according to the log file, counting unitary event sequences, searching out a frequent unitary event sequence set, and obtaining a binary frequent event sequence candidate set C (2); performing statistics on support degree counting and posterior degree counting of the candidate binary frequent event sequence in the C (2), and calculating the degree of confidence and posterior degree; generating a binary frequent event sequence set F (2) and a binary rule set R (2); repeating the process until F(k) and R(k) are obtained, performing join operation on k-element frequent event sequences in the F(k), and generating an F(k+1)-element frequent event sequence set; performing approximate calculation on attribute values of elements which are not in R(k+1) but in F(k+1), until all frequent event sequences are generated; finding the event correlation rule according to the frequent event sequences; and predicting events in the log according to the event correlation rule on line.

Description

technical field [0001] The invention relates to the field of high-performance networks, in particular to an online log analysis method. Background technique [0002] A cluster system is a highly available, high-performance, and highly scalable computer system with a single system image formed by a group of computer systems (nodes) interconnected through a high-performance network or a local area network. Each of its nodes is a complete computing system that can work independently. Since its inception, the cluster system has quickly become the mainstream architecture of high-performance computing due to its good scalability and competitive performance / price ratio. At the same time, the cluster system has also been widely used in commercial fields such as Internet services and database services. However, with the continuous increase of the scale of the cluster system, failure has become a normal state, and various problems such as software and hardware defects, load, environm...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L12/24H04L12/26H04L29/06
Inventor 周伟詹剑锋王磊任睿
Owner INST OF COMPUTING TECH CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap