A system and method for remotely collecting, retrieving and displaying application system logs

An application system and log technology, applied in transmission systems, special data processing applications, instruments, etc., can solve the problems of inability to dynamically monitor abnormal logs in real time, return log records, and occupy a large amount of network bandwidth, and achieve efficient remote log retrieval. solutions, efficient solutions, the effect of reducing additional costs

Active Publication Date: 2017-05-03
SHANGHAI BAOSIGHT SOFTWARE CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] 1) Local log collection: directly collect the running logs of the service on the host where the application service is deployed. It is often very difficult to deploy on-site environments, especially for environments such as coal mines, steelmaking, and highway toll stations; secondly, for those problems that require dynamic monitoring and retrieval of logs to find system error patterns, it is often impossible to pass the user Provide log information in real time, which requires our product development and maintenance personnel to go to the site to dynamically observe and analyze the logs, which undoubtedly increases a lot of extra costs; once again frequently entering the site to view logs, analyzing problems also increases users' distrust of the product ;
[0005] 2) Simple remote log collection: by adding a log acquisition function module to the application system, and then obtaining logs through a specific terminal, when this solution is implemented, it can only be refined to obtain all logs of a specific module or logs of a certain day. Due to the lack of effective It usually takes a lot of time and takes up a lot of network bandwidth to obtain a large number of logs generated when the system is abnormal, and it is impossible to dynamically monitor the abnormal logs of specified conditions in real time, which is especially important for problems that need urgent repairs on site. inefficient
[0007] This patent provides a method for obtaining log information of remote terminals, but each request can only return all log information, and cannot incrementally return the latest log records. For monitoring service operation through remote real-time dynamic monitoring system service logs The efficiency of the demand is very poor, or even unable to meet the demand, because it does not provide an effective incremental request mechanism and an efficient retrieval algorithm to reduce the number of records for each log request, thereby reducing the bandwidth occupied by network transmission and providing remote access to terminals. log efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A system and method for remotely collecting, retrieving and displaying application system logs
  • A system and method for remotely collecting, retrieving and displaying application system logs
  • A system and method for remotely collecting, retrieving and displaying application system logs

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0046] Shanghai Baosight Software Co., Ltd.’s high-performance real-time database, kernel and background service deployment servers deploy the server system LogServer synchronously. Through the client system LogViewer, the program running logs can be obtained quickly and effectively, and the running status of the program can be monitored.

[0047] The log fields of the background service recording log information in this embodiment include multiple fields such as generation time, level, error code, process id, thread id, source file, function, and detailed information. Such as figure 1 The solution shown is deployed using the CS architecture, and the specific deployment solution is as follows:

[0048] 1) Install LogServer and the service that needs to collect logs on the same machine, and configure the LogServer log collection directory as the directory where the service generates logs;

[0049] 2) Run LogViewer on any terminal, add the server that needs to collect logs, and...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a system and a method for remotely collecting, retrieving and displaying application system logs. The method comprises the following steps: installing a server-side system (LogServer for short) and services needing to collect logs on the same machine, and configuring a LogServer log collecting directory as a directory for generating logs for the services; adding servers needing to collect logs into any terminal running client system (LogViewer for short) in order to retrieve corresponding logs according to certain conditions. The server-side system comprises a log index module, a log retrieval module, a log compression module and a log transmission module. The client system comprises a request preprocessing module, a request processing module, a local log caching and maintenance module, a log retrieval module and an information display module. By adopting the system and the method, the locating and solving efficiencies of application system problems can be increased greatly, the running and maintenance costs of an application system are lowered effectively, and the completeness and reliability of the application system are improved.

Description

technical field [0001] The present invention relates to a log collection system and method, in particular to a system and method for remotely collecting, retrieving and displaying application system logs, especially a high-performance remote log retrieval method and a flexible filtering and display scheme for massive logs. Background technique [0002] Logging is an indispensable function of almost all application systems. In order to ensure the traceability and recoverability of application system errors, we often record a large number of logs to effectively check and monitor the operation of the system, and quickly locate the problems that occur in the operation of the system. question. For a large number of logs, how to quickly and efficiently retrieve logs, especially for those servers deployed in places where operation and maintenance personnel are difficult to access, how to collect and retrieve logs remotely is a particularly prominent problem. [0003] In the prior ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30H04L29/08
CPCG06F16/134G06F16/172G06F16/1744G06F16/1815H04L67/025
Inventor 鲍远松王亚东朱从锋时俊普董文生范昀
Owner SHANGHAI BAOSIGHT SOFTWARE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products