Log distribution acquisition analysis method and system thereof

A collection, analysis, and distributed technology, applied in transmission systems, digital transmission systems, electrical components, etc., can solve the problems of analysis server crashes, affecting system use, etc., to improve analysis performance, increase flexibility, and reduce burdens.

Inactive Publication Date: 2012-01-04
ZICT TECH CO LTD
View PDF3 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This technology has distributed collection and distributed analysis, but there is no combined distributed system. The analysis server bears too much pressure. After a long period of massive log processing, it is at the IO peak for a long time, which will lead to analysis. The server crashes, seriously affecting the use of the system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log distribution acquisition analysis method and system thereof
  • Log distribution acquisition analysis method and system thereof
  • Log distribution acquisition analysis method and system thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] In order to make the technical problems, technical solutions and beneficial effects to be solved by the present invention clearer and clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0022] The goal of this solution is to achieve the fastest speed for processing massive logs, so that the upstream system can obtain the most timely and effective data display, and bring a better experience to users.

[0023] Method of the present invention is as follows:

[0024] Multiple servers are used as distributed collection servers, and the collection servers are used for filtering and formatting processing at the same time, and multiple servers are used as distributed analysis servers, and the strategies between analysis servers can be flexibly...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provide a log distribution acquisition analysis method which comprises the following steps: a log acquisition distribution module acquires log data flow; the log acquisition distribution module carries out filtering and formatting processing on the log data flow, and sends the data flow after formatting processing to a log analysis distribution module; the log analysis distribution module analyzes the data flow according to an analysis strategy, and sends the log data flow after analysis to front application. The invention also provides a log distribution acquisition analysis system. According to the log distribution acquisition analysis method and the system thereof, burden of an analysis server can be lightened when the analysis server rapidly process mass logs simultaneously, integral log acquisition analysis performance is improved, upstream front application can obtain timely and effective data display, and better experience is brought to a user.

Description

technical field [0001] The invention relates to the field of computers, in particular to a method and system for distributed collection and analysis of logs in the field of computer log management. Background technique [0002] At present, there are log management products such as SIME\SOC\SIM\SEM in the industry, all of which involve log collection and analysis modules. The overall efficiency of analysis is not very high, which will undoubtedly affect the upstream system (front-end application) using logs, and the user experience will not be timely. At the same time, the long-term massive log processing and the IO peak for a long time may even lead to the collapse of the log collection and analysis system, and the crash of the log collection and analysis server, which seriously affects the use of the system. [0003] At present, there is a way to use multiple servers as distributed collection servers and multiple servers as distributed analysis servers, and the strategies ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L12/24H04L29/08
Inventor 温小明
Owner ZICT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap