Cache management method and device

Abstract

The application aims to provide a cache management method and device. The method comprises: storing first index information of each data block and the data block to a disk, wherein the storage position of the data block in the disk corresponds to the first index information; and writing all first index information in the disk into corresponding caches. Compared with the prior art, multiple pieces of index information established with the method can break through value range limitation of single piece of index information to realize query on mass data; meanwhile, the matching of query keywords is performed in the cache with relatively high access speed, so that the query speed is greatly increased; and in addition, the data blocks stored in the disk are stored in the caches when necessary as needed, so that the cache space is saved while the query efficiency is ensured. Through the cache management method and device, users can quickly access to the mass data, so that great convenience is brought for applications of instant data statistics, calculation, analysis and the like on the basis of obtaining the mass data.

Description

technical field

[0001] The present application relates to the field of computers, in particular to a cache management technology. Background technique

[0002] With the development of the Internet, various computing engines and application systems have put forward higher requirements for data management, hoping to access more data and increase the speed of accessing data.

[0003] Currently, the schemes adopted in this field are:

[0004] One is the full memory hash index technology. In this solution, all data is cached in memory, so the amount of hash index data is limited by the memory size, and the index of massive data cannot be realized.

[0005] The other is the disk hash index technology. In this scheme, all the data is stored on the disk. Although a small part of the data and its hash key are cached in memory, most queries require disk IO read operations during index query, which greatly reduces the query access cost. speed. Contents of the invention

[0006] ...

Examples

Embodiment Construction

[0022] The application will be described in further detail below in conjunction with the accompanying drawings.

[0023] In a typical configuration of the present application, the terminal, the device serving the network and the trusted party all include one or more processors (CPUs), input / output interfaces, network interfaces and memory.

[0024] Memory may include non-permanent storage in computer-readable media, in the form of random access memory (RAM) and / or nonvolatile memory, such as read-only memory (ROM) or flash memory (flashRAM). Memory is an example of computer readable media.

[0025] Computer-readable media, including both permanent and non-permanent, removable and non-removable media, can be implemented by any method or technology for storage of information. Information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), sta...

technical field

[0001] The present application relates to the field of computers, in particular to a cache management technology. Background technique

[0002] With the development of the Internet, various computing engines and application systems have put forward higher requirements for data management, hoping to access more data and increase the speed of accessing data.

[0003] Currently, the schemes adopted in this field are:

[0004] One is the full memory hash index technology. In this solution, all data is cached in memory, so the amount of hash index data is limited by the memory size, and the index of massive data cannot be realized.

[0005] The other is the disk hash index technology. In this scheme, all the data is stored on the disk. Although a small part of the data and its hash key are cached in memory, most queries require disk IO read operations during index query, which greatly reduces the query access cost. speed. Contents of the invention

[0006] ...

Examples

Embodiment Construction

[0022] The application will be described in further detail below in conjunction with the accompanying drawings.

[0023] In a typical configuration of the present application, the terminal, the device serving the network and the trusted party all include one or more processors (CPUs), input / output interfaces, network interfaces and memory.

[0024] Memory may include non-permanent storage in computer-readable media, in the form of random access memory (RAM) and / or nonvolatile memory, such as read-only memory (ROM) or flash memory (flashRAM). Memory is an example of computer readable media.

[0025] Computer-readable media, including both permanent and non-permanent, removable and non-removable media, can be implemented by any method or technology for storage of information. Information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), sta...

Images