Cache system and method supporting real-time change notification and real-time data synchronization
A real-time synchronization and data synchronization technology, applied in transmission systems, database indexing, structured data retrieval, etc., can solve problems such as the inability to use the cache method and the lack of a cache method, and achieve the effect of reducing network overhead
Pending Publication Date: 2021-01-05
成都精灵云科技有限公司
View PDF0 Cites 2 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
In the scenario that requires real-time notification of data changes (i.e. publish and subscribe functions), this type of caching method cannot be used. There are existing databases that support notifications similar to the etcd database, and there is no caching method that meets the scenario.
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment
[0036] The remote database used in this embodiment is an etcd key-value database, and the implementation carrier of this embodiment is an application program. The overall structural diagram of the memory cache in this embodiment is shown in figure 2 , therefore, this embodiment specifically includes the following steps:
[0037] Step S1: When the data synchronizer is started, perform a list query on the directory (such as ` / newben / `) that needs to be cached in etcd, and store the list results in the memory map according to the corresponding key value in turn.
[0038] Step S2: Use the reversion in the list data to start the watch operation to etcd to establish a grpc long connection for data change monitoring. list+watch can create a full cache in memory. When a data change is monitored, the change will be updated to the memory cache. In order to prevent watch interruption and data loss, the data synchronizer will execute step S1 and step S2 every 10 minutes to resynchroniz...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a cache system and method supporting real-time change notification and real-time data synchronization, and belongs to the field of enhanced memory cache. The system comprises adata synchronizer, a memory cache, a cache change monitor and a subscription registrar. The method comprises the steps of: starting a data synchronizer, and when a memory cache is started, caching all data in a far-end database to a local memory; enabling the data synchronizer to update the cache content of the memory according to the change event when the data is changed; adding the monitoring layer which is used for monitoring modification operation on the memory cache, generating and pushing an event to the subscription registrar when an adding, deleting, modifying and checking interface provided for the outside is called, and enabling the registrar to distribute the modification and / or updating of the memory cache to a corresponding subscriber; and starting and using the subscriptionregistrar for receiving a subscription request from a caller, establishing a persistent channel between the subscription registrar and the caller, and pushing an event to the subscription channel whencorresponding data modification and / or updating of the memory cache exist / exists.
Description
technical field [0001] The invention relates to the field of enhanced memory cache, in particular to a cache system and method supporting real-time notification of changes and real-time data synchronization. Background technique [0002] Caching technology has always been used to reduce the number of direct interactions with the database to improve stand-alone performance. The traditional memory cache technology is stored in the form of key-value pairs. When using it, it is first searched from the memory, and if it does not exist, it is queried to the database, and then the database query result is used to fill the memory cache. In the scenario that requires real-time notification of data changes (that is, the publish and subscribe function), this type of caching method cannot be used. There are existing databases that support notifications similar to the etcd database, and there is no caching method that meets the scenario. Contents of the invention [0003] The object o...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): H04L29/08G06F16/27G06F16/22
CPCH04L67/1095G06F16/2282G06F16/27H04L67/568
Inventor 晏东吴晓勇安露明张李昆
Owner 成都精灵云科技有限公司