Method and system for log collection and monitoring of distributed server

Abstract

The present invention provides a log collection and monitoring method for distributed servers. The method includes the following steps: Step S1, collecting site logs of each server respectively, and storing the collected log data on the directories of the respective servers, and each Each server has a corresponding server IP; step S2, through the interface, receive the log data collected by each server and store it in the message queue, and then read the log data from the message queue one by one, and log data according to the server IP and log time. Make distinctions and store them in redis; step S3, read the collected log data from redis, and display it through the visual page; step S4, query the log counter in the zset ordered set of redis regularly, when the log If the counter exceeds the set quantity, the site manager will be notified by SMS or email; the work efficiency is improved.

Description

technical field [0001] The invention relates to the technical field of computer communication, in particular to a log collection and monitoring method and system of a distributed server. Background technique [0002] With the increase of web page business, the traffic of the website increases accordingly. In order to meet the larger scale, the website will be deployed in a distributed manner, and one site is deployed on multiple servers. Before distributed deployment, the logs of a single server were stored in a certain file directory of the server, but as the number of servers increases, the log lookup of the same site will become more and more difficult. Because when the log in question appears, I don't know which server the problem will occur on, and there is a problem of difficult positioning. It is necessary to browse the logs from multiple servers, the search is slow, and the access is not intuitive. This is undoubtedly an inefficient way of working. . SUMMARY OF TH...

AI Technical Summary

Problems solved by technology

Before distributed deployment, the logs of a single server are stored in a certain file directory of the server, but as the number of servers increases, it will become more and more difficult to find the logs of the same site

Because when a problematic log appears, it is not known which server the problem will occur on, and there is a problem of difficult location. You have to browse the log from multiple servers, the search is slow, and the access is not intuitive. This is undoubtedly an inefficient way of working.

Images