System and method for collecting, searching, and analyzing offline log

A technology for analyzing systems and logs, applied in the computer field, can solve the problems of difficulty in log integration and analysis, and achieve the effects of convenient operation, cost saving and time saving.

Inactive Publication Date: 2016-01-20
CHENGDU STARCOR INFORMATION TECH
View PDF5 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At the same time, when the company has a wide range of business, the logs are distributed on servers in different regions. Due to the privacy of the business, only a few servers can be accessed from the external network. At this time, how to integrate and analyze these logs is also a big problem. problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method for collecting, searching, and analyzing offline log
  • System and method for collecting, searching, and analyzing offline log

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0039] Such as figure 1 As shown, an offline log collection, query and analysis system is provided, including a pushing device, a monitoring device, a replay device, a log collection and cutting device, a log storage retrieval device, and a data display device. The pushing device is used to obtain logs on a node server, And push it to the central server in real-time in the form of classification. The monitoring device is used to monitor the log catalog on the central server, and when the log file in the log catalog changes, the path of the log file that will change and The category tag information is written as a piece of information into the message queue for storing data information, and the replay device is used to read the information containing the changed log file information from the message queue, and reset the content of the changed log file In a file corresponding to the type of the changed log file, the log collection and cutting device is used to read the reset file ...

Embodiment 2

[0048] Such as figure 2 As shown, on the basis of Embodiment 1, the offline log collection, query and analysis method provided includes the following steps:

[0049] Step S10: The pushing device obtains the log on the node server, and pushes it to the central server in real time in the form of category distinction;

[0050] Step S20: The monitoring device monitors the log catalog on the central server, and when the log file in the log catalog changes, the path and category label information of the changed log file are written as a piece of information for storing data Information in the message queue;

[0051] Step S30: The replay device reads the information containing the changed log file information from the message queue, and resets the content of the changed log file to a file uniquely corresponding to the type of the changed log file;

[0052] Step S40: The log collection and cutting device reads the reset file from the playback device, splits the read file, and sends the spli...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a system and method for collecting, searching, and analyzing an offline log. A push apparatus acquires a log on a node server, and pushes the log to a central server in real time. A monitoring apparatus monitors a general log list on the central server, and writes a path and category label information of a changed log file into a message queue. A relocating apparatus reads information which comprises information of the changed log file from the message queue, and relocates contents of the changed log file in a file corresponding to the changed log file in classification. A log collection and dividing apparatus divides a read file, and sends information after the division to a log storing and searching apparatus. The log storing and searching apparatus stores received information and performs classification indexing on received information. A data presentation apparatus presents found data. According to the system and method for collecting, searching, and analyzing an offline log provided by the invention, real-time collection, analysis and data presentation of offline logs of different regions are realized, and a problem processing time is saved.

Description

Technical field [0001] The invention relates to the field of computer technology, in particular to an offline log collection, query and analysis system and method. Background technique [0002] With the development of computer technology, the era of big data has arrived. Logs generated by programs and systems are becoming more and more important. In a pile of log files, centralized management and statistical analysis are more necessary. The traditional method of log collection and analysis is to query the specified files according to different log file names, and then collect and analyze the files. However, when the number of machines to be viewed is very large, how to quickly find and analyze logs becomes more and more important. At the same time, when the company's business is very wide, the logs are distributed on servers in different regions. Due to the privacy of the business, only a few machines can access the external network. At this time, how to integrate and analyze th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06F11/30
CPCG06F11/3065G06F16/248G06F16/27
Inventor 陈朱尧叶鹏
Owner CHENGDU STARCOR INFORMATION TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap