Log collection method and device

Abstract

The invention discloses a log collection method and device, and relates to the technical field of computers. A specific embodiment of the method comprises the following steps: determining a log file corresponding to each log according to the generation time of each log and the time interval of each log file; writing each log into a log file corresponding to the log to form a log file set; and storing the logs in the log file set to a target storage position. According to the implementation mode, the logs are written into the corresponding log files according to the generation time of the logs,and the situation of log missed collection can be avoided; and the collection state of each log is kept, so that the collection site of each log can be known conveniently, and breakpoint continuous collection is realized. According to the technical scheme provided by the embodiment of the invention, lossless carrying from the system log to the offline analysis system can be realized.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a log collection method and device. Background technique [0002] With the continuous development of the Internet, the Internet has entered the DT era from the IT era, and data has become the raw material for the company's gold digging, and has become the company's most valuable asset. However, before data mining and machine learning, data collection Work is also a very important part of it. Reliable data collection tools play a big role in the subsequent work. [0003] In the prior art, when collecting data, the generated logs are first stored in the a.log file, and then the logs in the a.log file are sent to the target location. Specifically, when the generated log is stored in the a.log file, it is judged whether the time when the log is generated spans days, if not, the log is stored in the a.log file; if it is spanned, the current Rename the a.log file, create a ...

AI Technical Summary

Problems solved by technology

[0005] 1. During the file renaming process, some newly generated logs will still be stored in the renamed file, and the log storage location is confusing, which may easily lead to missing logs;

[0006] 2. The log collection site cannot be saved, and re-collection at breakpoints cannot be realized

Images