Data distributed cache automatic loading and conversion method

A distributed cache and automatic loading technology, applied in the database field, can solve the problems of increasing the pressure of distributed data indexing and the inability to efficiently cache and apply original data, so as to enhance the cache effect, reduce the impact of dirty data, and improve The effect of retrieval speed

Inactive Publication Date: 2021-12-10
BEIJING TESTOR TECH +1
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In order to overcome the above-mentioned defects of the prior art, the present invention provides a data distributed cache automatic loading and conversion method. The technical problem to be solved by the present invention is: for the cached data, the current cached data is stored in a certain equivalent The cached data that loses its timeliness will be cleaned up, and the cleaned data still has a great possibility of being called, which will invisibly further increase the pressure on the distributed data index, making it impossible to achieve efficient caching of the original data Read and Apply Questions

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data distributed cache automatic loading and conversion method
  • Data distributed cache automatic loading and conversion method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0032] A data distributed cache automatic loading and conversion method, including the following methods:

[0033] Step 1: Establish a distributed data cache, realize hash calculation through the MurmurHash calculation method, simulate a ring structure through Java's TreeMap, and achieve uniform distribution of data consistency hash cache nodes.

[0034] Step 2: The original data is stored in the underlying database of the distributed data cache.

[0035] Step 3: Establish a middle-level collection database based on the distributed data cache, and load a data search engine based on the middle-level collection database.

[0036] Step 4: Establish a three-tier cache in the collection database, and read the pre-cleaned cache in advance to realize the cache data trash can integration strategy.

[0037] The feature search engine is composed of multiple source search Engine installations, and the meta search engine is installed in the lower layer.

[0038] The three-tier cache dat...

Embodiment 2

[0042] A data distributed cache automatic loading and conversion method, including the following methods:

[0043] Step 1: Establish a distributed data cache, realize hash calculation through the MurmurHash calculation method, simulate a ring structure through Java's TreeMap, and achieve uniform distribution of data consistency hash cache nodes.

[0044] Step 2: The original data is stored in the underlying database of the distributed data cache, and feature extraction is performed on the data.

[0045] Step 3: The feature data extracted in step 2 establishes an index hyperlink with the corresponding original data, and extracts the original data and deploys the corresponding data nodes located in the simulated ring structure.

[0046] Step 4: Establish a middle-level collection database based on the distributed data cache, and load a feature search engine based on the middle-level collection database.

[0047] Step 5: Establish a three-tier cache in the collection database, a...

Embodiment 3

[0053] A data distributed cache automatic loading and conversion method, including the following methods:

[0054] Step 1: Establish a distributed data cache, realize hash calculation through the MurmurHash calculation method, simulate a ring structure through Java's TreeMap, and achieve uniform distribution of data consistency hash cache nodes.

[0055] Step 2: Store the original data in the underlying database of the distributed data cache and perform feature extraction processing on the data.

[0056] Step 3: The feature data extracted in step 2 establishes an index hyperlink with the corresponding original data, and extracts the original data and deploys the corresponding data nodes located in the simulated ring structure.

[0057] Step 4: Establish a middle-level collection database based on the distributed data cache, and load a feature search engine based on the middle-level collection database.

[0058] Step 5: Establish a three-tier cache in the collection database, ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data distributed cache automatic loading and conversion method, and particularly relates to the technical field of databases. According to the method, an annular storage structure based on the existing consistent Hash distributed data is realized by adopting a consistent Hash uniform distribution cache mode; by adopting the feature extraction of the stored data, the data is converted into features, and a corresponding set database is created for the features; by adopting an independent search engine to index the content, the distributed big data is subjected to unified set indexing, so that the retrieval speed is increased, and meanwhile, according to the hyperchain correspondence of data nodes, a mode of accurately reading the data and synchronously cooperating with three layers of caches is formed; and for the cache data with timeliness, the cleared cache data is independently stored, the collection of high-frequency files is realized; through the distributed storage data calling again, the data pressure of the distributed storage is relieved to a certain extent, and meanwhile, the cache effect is further enhanced.

Description

technical field [0001] The invention relates to the technical field of databases, and more specifically, the invention relates to a method for automatically loading and converting data distributed caches. Background technique [0002] Redis is the abbreviation of Remote Dictionary Server (Redis). It is a key-value storage system written by Salvatore Sanfilippo. It is a log-type Key written in ANSI C language, complies with the BSD protocol, supports the network, and can be memory-based or persistent. -Value database, and provide APIs in multiple languages. In many places, Redis is also called a data structure server by industry insiders, because it allows the cached value (value) to be a string (string), hash (hash), list (list), set (set) and ordered Collection (sorted set) and other types. In addition, Redis also supports data backup in master-slave mode. [0003] As for the way of Redis distributed cache, the traditional data indexing method will form a large data inde...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22G06F16/2455G06F16/2458G06F16/27G06F16/28G06F16/953
CPCG06F16/2228G06F16/24552G06F16/2471G06F16/27G06F16/284G06F16/953
Inventor 陈忠国李忱周鑫江何门殿春孟繁荣姚志强
Owner BEIJING TESTOR TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap