Method and device for sorting log data

Abstract

The embodiment of the invention provides a method and device for sorting log data. The method comprises the steps that for each minimum time unit in the sorting period, intermediate storage files corresponding to the minimum time units respectively are sequentially created according to the time sequence, and an intermediate storage file set is obtained; a log file is obtained, and the log data inthe log file is read sequentially, wherein the following operations are conducted on each log data that the record time of the current log data is read through analysis, the intermediate storage filecorresponding the minimum time unit where the analyzed record time belongs is determined from the intermediate storage file set, and the read current log data is stored in the determined intermediatestorage file; the intermediate storage files are sequentially read according to the time sequence, and the log data in the read intermediate storage files is sequentially stored in a log storage file.By means of the method, a huge quantity of data can be quickly and easily sorted.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a method and device for sorting log data. Background technique [0002] With the rapid development of computer technology, people's lives are increasingly dependent on various Internet application products, and a large amount of data will be generated when users use Internet application products. In order to ensure network security during the operation of Internet application products, log Data played an important role. For example, log data from various operating systems, applications, devices, and security products can help Internet product operators discover and avoid disasters, and find the root cause of security incidents. Therefore, Internet product operators need to analyze a large amount of log data Read analysis. In the prior art, the storage method of log data is often sorted and stored according to time order, so that the log data is roughly ordered logs. For examp...

AI Technical Summary

Problems solved by technology

[0003] In the process of realizing the present invention, the inventor found that there are at least the following problems in the prior art: when the data volume of the log log is huge, random reading of the log log will become very difficult, and only sequential line-by-line reading can guarantee The performance of the read operation, although the operation of reading log data in this way is simple, it cannot be applied to the situation where the amount of data in the log file is huge

Images