Method for searching multi-archive file based on temporary table

Abstract

The invention discloses a method for searching a multi-archive file based on a temporary table. The method comprises the following steps: A, filtering archive files to be enquired according to a query requirement; B, evaluating the size of space of a temporary database for loading the archive files; and executing a step C if the space of the temporary database is sufficient; C, recovering recordsin the archive files to be enquired into the temporary table in the temporary database one by one by adopting a batch duplicating mode, and realizing data sharing among multiple queries by taking an archive file as a unit by using a two-level cache mechanism; and D, acquiring data from the temporary table according to a query condition. The method can carry out two-level cache on the loaded archive files through accelerating speed of loading the file to the temporary table so as to optimize the query efficiency of multi-archive file.

Description

technical field [0001] The invention relates to the technical field of software development using a database (Database) as a data storage medium, in particular to a multi-archive file query method based on a temporary table. Background technique [0002] In a large-scale database application system, in order to avoid database space overflow, historical data must be archived, and at the same time, it is supported to query the archived files. For example, in the telecommunications network management system, a large number of historical alarms, performance and other data must be archived regularly, and the query of the archived files is based on a temporary table, which is also a method widely used at present. The specific scheme is as follows: [0003] (1) Create a temporary table in the temporary database; [0004] (2) Load the contents of the archive file into a temporary table [0005] (3) Query eligible records from the temporary table [0006] The above query scheme ca...

AI Technical Summary

Problems solved by technology

[0006] The above query scheme can meet the query requirements of a single archive file, but sometimes users need to query multiple archive files at a time. Further summarization will definitely not be able to meet the needs of users well, so it is necessary to query all the alarm archive files within this period at one time; in this case, there are space and efficiency problems at the same time if the above solution is adopted

First of all, if there are many archive files involved in a query, such as querying the past month or a quarter, the amount of records is too large, which may cause the temporary database space to overflow; secondly, if the records in the archive files are inserted into the temporary table one by one In the case of a large amount of records, the entire loading process will be very slow

In addition, querying archive files generally adopts the method of page-by-page query. If each page of query is reloaded, the efficiency is definitely unacceptable to users. This can be optimized by caching the loaded archive, such as saving a loaded file in the system. In the way of file linked list, if the archive file to be queried has already been loaded, there is no need to reload it. This is a better solution for searching a single archive file, but it still cannot meet the requirements for multiple archive files.

If all archive files are restored to a temporary table, the granularity of the cache is too large, as long as there is one file different between two queries, all files must be reloaded, and it also affects the efficiency of recovery; if each file Restoring to a separate temporary table can realize file-based sharing, but it is difficult to query multiple tables at the same time to achieve paging query or network-wide sorting, and it is not an ideal solution

Images