Log processing method, device, storage medium, and server

Abstract

The invention relates to the technical field of telephone traffic, computer network calculation, data analysis, retrieval, storage and backup, in particular to a log processing method provided by theembodiment of the invention, comprising the following steps: a target telephone traffic log is backed up to a corresponding network memory, and the network memory is allocated with a network protocoladdress; a server is linked for analyzing a target traffic log to a network protocol address such that the server analyzes the target traffic log; the compressed log is obtained by compressing the analyzed target traffic log, and the compressed log is stored according to the archiving path specified by the network memory. The log is copied over a proprietary network for re-analysis. The inventionensures the timeliness and also reduces the excessive occupation of the analysis and compression of the log, which occupies the resources such as the cpu. The invention realizes the distributed analysis and compression by backing up the compression of the log to the network memory and hanging the server of the analysis log to backup the path of the network memory of the log, and solves the performance bottleneck of the analysis.

Description

technical field [0001] The invention relates to the technical fields of traffic, computer network computing, data analysis, retrieval, storage, and backup, and in particular to a log processing method, device, computer-readable storage medium, and server. Background technique [0002] With the rapid development of the Internet industry, especially the sudden emergence of mobile applications, the door to a new round of data explosion era has been opened, and the competition among various online applications is heating up. Among them, some logs can not only reflect the running status of the server, but the other part of the logs provide important indicators for business development planning. In particular, in the traffic system, because it is necessary to analyze the abnormal traffic, or query the user's query on the traffic, it can only be analyzed through the tserver log, because the log structure is completely different from that of the web, and there is a difference betwee...

AI Technical Summary

Problems solved by technology

In particular, in the traffic system, because it is necessary to analyze the abnormal traffic, or query the user's query on the traffic, it can only be analyzed through the tserver log, because the log structure is completely different from that of the web, and there is a difference between the main and backup logs. Both the master and the backup will output logs. It is necessary to distinguish between the master and the backup, and the analysis becomes very difficult. In addition, cross-platform traffic transfer is involved, which makes traffic analysis difficult. In addition, because the logs will be cleared, the program itself has no backup.

In addition, the amount of logs generated in a full platform is very large. The log volume of tserver logs per second on a single platform is about 5M, and the analysis and compression take up a lot of cpu, which cannot be satisfied by a single platform. As a result, the analysis of tserver logs on a single platform becomes a problem. Bottlenecks in transaction log analysis and location

Images