Retrieval device and retrieval method for log database

Abstract

Embodiments of the invention provide a retrieval device and a retrieval method for a log database. The device comprises an index creation module, a retrieval module and an index management module, wherein the index creation module is used for obtaining new log data, establishing a full-text index after carrying out format conversion on new log data and storing the full-text index in a disk in a file form; the retrieval module is used for receiving a search request, searching according to the search request and an index in an internal storage, and returning a search result; and the index management module is used for judging whether the index involved in the search request received by the retrieval module is in the internal storage, and if no, loading the index involved in the search request in the internal storage from the disk. According to the retrieval device and the retrieval method, the index is stored in the disk in a file form and is loaded in the internal storage as needed, so that the retrieval efficiency can be improved. Meanwhile, the index file is not maintained, but the index is blocked, so that index increment type extension is realized, a large amount of IO operations caused by updating the index is avoided, and the search efficiency is improved.

Description

technical field [0001] The invention relates to the technical field of databases, in particular to a log database retrieval device and retrieval method. Background technique [0002] Enterprise-level databases usually store tens of thousands of data. Taking the auditing system as an example, it is very common to store hundreds of millions or even billions of logs for auditing in its database. When this kind of log database stores massive data, it is very important for auditing and other work to realize convenient and fast retrieval in the massive data. [0003] In the existing technology, the index established for the log database is stored in the memory of the system. When the user calls the index, he will find the unique identifier of the log in the database from the memory, and then retrieve it in the database. This method will greatly increase the The computing load of the database reduces the efficiency of retrieval; and when the index is updated, a large number of IO...

AI Technical Summary

Problems solved by technology

[0003] In the existing technology, the index established for the log database is stored in the memory of the system. When the user calls the index, he will find the unique identifier of the log in the database from the memory, and then retrieve it in the database. This method will greatly increase the The computing load of the database reduces the efficiency of retrieval; and when the index is updated, a large number of IO operations will be performed on the index in memory to update the index established in memory, which will also reduce the retrieval efficiency

Images