Redis-cannal cross-machine room cache synchronization system

A synchronization system, cross-machine room technology, applied in the field of real-time two-way synchronization of data in Internet systems, can solve the problems of not supporting Redis cluster mode synchronization, not supporting synchronization system disaster recovery, not supporting bidirectional synchronization, etc.

Pending Publication Date: 2021-02-26
TIANYI ELECTRONICS COMMERCE
View PDF5 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the field of Redis cache multi-computer room synchronization technology, some similar products do not support two-way synchronization, some do not support Redis cluster mode synchronization, and some do not support the disaster recovery function of the synchronization system. These shortcomings will occur in the actual use of the production environment some restrictions
For example, for data synchronization products that do not support Redis cluster mode, the production environment can only use Redis in Sentinel mode, which will be very inconvenient for business users

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Redis-cannal cross-machine room cache synchronization system
  • Redis-cannal cross-machine room cache synchronization system
  • Redis-cannal cross-machine room cache synchronization system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0045] Such as Figure 1-8 As shown, the present invention provides the Redis-canal cross-computer room cache synchronization system of the present invention, which is implemented based on the Redis replication protocol, uses the PSYNC command to obtain the write command generated by the Redis master node in real time, and re-orders the command in the target computer room through the synchronization system The entire system is divided into three layers: console Apollo, node discovery and data retention layer ZK, and data synchronization layer Redis-canal. Among them, console Apollo is responsible for task configuration, startup and shutdown tasks, and cross-computer room cluster deployment; The computer room is independently deployed, responsible for the registration and discovery of Redis-Canal nodes, task scheduling and synchronization task data collection; Redis-Canal is the final executor of Redis synchronization tasks, including canal and sync modules; Canal is responsi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a Redis-cannal cross-machine room cache synchronization system, which is realized based on a replication protocol of Redis, uses a PSYNC command to acquire a writing command generated by a Redis main node in real time, replays the command in a target end machine room through a synchronization system, and is divided into three layers: a console Apolilo, a node discovery anddata reservation layer ZK and a data synchronization layer Redis-canal. The invention is realized based on a Redis replication protocol, a writing command generated by a Redis main node is acquired inreal time by using a PSYNC command, and the command is replayed in a target end machine room through a synchronization system; based on a Redis replication protocol scheme, improvement and optimization are carried out, and the following three problems are solved: 1, bidirectional synchronization is supported; 2, cluster mode synchronization is supported; and 3, the disaster tolerance capability of the synchronization system is supported.

Description

technical field [0001] The invention relates to the technical field of real-time two-way synchronization of data in an Internet system, in particular to a Redis-canal cross-computer room cache synchronization system. Background technique [0002] At present, in the Internet system architecture, the deployment scheme of multiple computer rooms in different places is being more and more applied in the production environment. The deployment scheme of multiple computer rooms will make the data source scattered in each computer room, so that the data of the computer rooms can be synchronized in real time. becomes particularly important. In the field of Redis cache multi-computer room synchronization technology, some similar products do not support two-way synchronization, some do not support Redis cluster mode synchronization, and some do not support the disaster recovery function of the synchronization system. These shortcomings will occur in the actual use of the production env...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L29/08
CPCH04L67/1095H04L67/568
Inventor钱宇炜马颂华陈裕頲黄峤睿任龄明毛震鹏吴振严永峰
OwnerTIANYI ELECTRONICS COMMERCE