Log server and its management method

Abstract

The invention relates to the field of log management services, in particular to a log server and a management method thereof. The log server of the present invention includes a message subscription and release module and a conversion system, the message subscription and release module receives, stores, and manages the first log file from the application server, and the conversion system stores the first log file in the message subscription and release module. The log file is converted into a second log file; the message subscription publishing module includes a session queue corresponding to the application server; the session queue includes a session area corresponding to the first log file of the application server. It is designed as a distributed system that is easy to scale out; it provides high throughput for both publish and subscribe; it supports multiple subscribers and can automatically balance consumers when it fails; it persists messages to disk, so it can be used for Batch consumption, such as ETL, and real-time applications.

Description

technical field [0001] The invention relates to the technical field of log management services, in particular to a log server and a management method thereof. Background technique [0002] In products related to communication and computer information processing, logs recorded during system operation play an important role in user system failures, early detection of warnings, and tracking of key operations. The log management system implemented based on activeMQ in the prior art is implemented based on JMS (Java Message Service). Control the log generation process through Log4j to control the destination of log information transmission, the output format of each log, and further write the log information of the server into the queue. The log management system may manage log messages generated by multiple application servers. For example, there are two web servers, and each server has four tomcats, which are output to tomcat through Log4j. When the log output to tomcat is to...

AI Technical Summary

Problems solved by technology

[0003] 1. The log file is deleted immediately after being consumed, which requires frequent operations on the disk, which increases the IO overhead of the disk;

[0004] 2. Unable to persist messages to disk;

[0005] 3. The centralized log processing system is not easy to expand outward;

[0006] 4. Does not support multiple subscribers, and cannot automatically balance consumers when consumption fails;

[0007] 5. The message header required by the JMS system is large, coupled with the overhead of maintaining various index structures, resulting in 144 bytes for each message of ActiveMQ

[0008] 6. When multiple ports of the client access one port at the same time, there will be concurrent conflicts

However, it cannot implement a distributed processing system, and the scalability is not high

Images