Unlock instant, AI-driven research and patent intelligence for your innovation.

Method, device and electronic equipment for data index construction and data reading

A data indexing and data reading technology, which is applied in database indexing, structured data retrieval, digital data protection, etc., can solve the problems of reducing the probability of cache being penetrated, and the cache is easy to be penetrated, so as to reduce the penetration The effect of the probability

Active Publication Date: 2020-05-26
ADVANCED NEW TECH CO LTD
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The embodiment of the present application provides a data index construction, data reading method, device and electronic equipment, which are used to solve the technical problem that the cache is easily penetrated in the prior art, and reduce the probability of the cache being penetrated

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, device and electronic equipment for data index construction and data reading
  • Method, device and electronic equipment for data index construction and data reading
  • Method, device and electronic equipment for data index construction and data reading

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0075] Please refer to figure 1 , the embodiment of the present application provides a method for constructing a data index, which is applied to an electronic device. The electronic device may be a client terminal or a server. The method includes:

[0076] S11: When storing data into the memory, generate the first data index of the stored data and add it to the Bloom filter to establish a full data index;

[0077] S12: When deleting data from the memory, generating a second data index of deleted data and establishing a deleted data index;

[0078] Wherein, the full data index and the deleted data index are used to determine whether the data to be read is in the memory before reading the data, and if the data to be read is not in the memory, it is forbidden to execute the The operation of reading the data to be read in the memory, otherwise, the operation of reading the data to be read is performed.

[0079] In a specific implementation process, the memory may be a cache and / ...

Embodiment 2

[0105] Based on the same inventive concept, for the data index construction method provided in Embodiment 1, the embodiment of the present application also provides a corresponding data index construction device, please refer to Figure 5 , the device consists of:

[0106] The first generation unit 51 is configured to generate a first data index of the stored data and add it to the Bloom filter to establish a full data index when storing the data in the memory;

[0107] The second generating unit 52 is configured to generate a second data index of deleted data and establish a deleted data index when data is deleted from the memory;

[0108] Wherein, the full data index and the deleted data index are used to determine whether the data to be read is in the memory before reading the data, and if the data to be read is not in the memory, it is forbidden to execute the The operation of reading the data to be read in the memory. Specifically, the memory may include a cache and / or ...

Embodiment approach

[0116] As an optional implementation, the device also includes:

[0117] A reading unit 63, configured to read the data to be read from the cache when the data to be read is in the memory and the memory is a database; if the data is read from the cache Failed to read the data to be read from the database.

[0118] In the specific implementation process, the judging unit 61 is configured to: judge whether there is an index of the data to be read in the deleted data index; if there is an index of the data to be read in the deleted data index, It is determined that the data to be read is not in the memory. Further, the judging unit 61 is further configured to: when there is no index of the data to be read in the deleted data index, judge whether there is an index of the data to be read in the full data index; if An index of the data to be read exists in the full data index, and it is determined that the data to be read is in the memory; otherwise, it is determined that the data...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data index construction method and device and electronic equipment. The method comprises the steps that when data is stored into a storage, a first data index for data storage is generated and added into a bloom filter to build a full data index; when the data is deleted from the storage, a second data index for the deleted data is generated and a deleted data index is built, wherein the full data index and the deleted data index are used for judging whether to-be-read data is in the storage or not before data reading is performed, and if the to-be-read data is not in the storage, the operation for reading the to-be-read data from the storage is forbidden from being executed. According to the technical scheme, the technical problem that in the prior art, a buffer is likely to be penetrated is solved, and the probability that the buffer is penetrated is lowered.

Description

technical field [0001] The present invention relates to the technical field of software, in particular to a data index construction and data reading method, device and electronic equipment. Background technique [0002] With the continuous development of science and technology, the data processing capability of processing equipment such as CPU has been developed rapidly. However, the reading and writing speed of the database that can store a large amount of data is much lower than the data processing speed of the processing equipment, making the high-speed calculation of the processing equipment ability is not fully realized. [0003] In order to make up for this deficiency, in the prior art, a cache is set between the processing device and the database as middleware commonly used in high-concurrency systems. The cache runs much faster than the memory and is used to improve data reading efficiency and system throughput. A common practice is to maintain a complete set of da...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F21/62G06F16/22
CPCG06F16/2272G06F21/6218
Inventor 郑色树
Owner ADVANCED NEW TECH CO LTD