Log management method and device in distributed environment

A distributed environment and management method technology, applied in the direction of database distribution/replication, electronic digital data processing, special data processing applications, etc., to achieve the effect of strong log query

Inactive Publication Date: 2014-03-05
用友汽车信息科技(上海)股份有限公司
View PDF5 Cites 47 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of the above problems, the present invention aims to provide a log management method and device in a distributed environment, to solve the problems of log management generated by applications during distribution and cluster deployment. Inconsistency with time causes various problems in using logs

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log management method and device in distributed environment
  • Log management method and device in distributed environment
  • Log management method and device in distributed environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] Related threads running in the log interceptor also include:

[0040] 1) Log packing thread: Obtain multiple pieces of original log data from the log queue to be packaged, and use a data compression algorithm to compress multiple pieces of log data into a data package. When one of the following two conditions is met, the packaging ends, and the data packet is stored in the data packet queue to be sent. Condition 1: The cumulative original size of K log data is greater than M byte. Condition 2: current time - start packaging time is greater than S seconds. The above parameters K, M, S can be set by the user according to the experience value. The log packaging threads may be a group of threads, and the number thereof may be determined according to the quantity and size of the log data to be packaged.

[0041] 2) Sending thread: Obtain the compressed data packet from the data packet queue to be sent, and send the data packet to the log center using the HTTP protocol. T...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a log management method and device in a distributed environment. The log management method in the distributed environment comprises the steps of intercepting and collecting log data, sending the log data, receiving the log data, carrying out analysis and handling on the centralized log data, storing the handled log data in a database, and providing the log data for a user so that the user can carry out query and statistics. When the log management method and device in the distributed environment are used, logs which are arranged at various physical storage positions in a scattered mode can be collected to a centralized log center in real time, log records in log files can be sequenced according to a unified time line sequence, and can be structurally stored, and the better functions of log query, log analysis and log statistics are provided. According to the log management method and device in the distributed environment, various problems, caused by inconformity of the time and the space of logs generated by applications when distribution, clustering and deployment are carried out, in the process of log utilization are solved, and query and statistics of the user are facilitated.

Description

technical field [0001] The invention relates to log management, in particular to a log management method and device in a distributed environment. Background technique [0002] Currently J2EE-based applications are widely used. In order to obtain the running status of the application and facilitate debugging, J2EE-based applications generally use some kind of log component to write the logs generated by the application in real time to the file system. Typical examples of logging components include Log4j, common-log, etc. Since J2EE-based applications are usually deployed in a cluster environment or a distributed environment, the logs at this time will be scattered on multiple physical machines. When you need to find or locate certain problems from the logs, you will face the following problems: 1) The space is not uniform, and the storage locations of the logs are scattered: because the applications are distributed or deployed in clusters, each application will be deploye...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06F11/34
CPCG06F11/3476G06F16/27
Inventor 孙凯
Owner 用友汽车信息科技(上海)股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products