Redis clustering method based on ZooKeeper

A cluster and algorithm technology, applied in digital transmission systems, electrical components, transmission systems, etc., can solve problems such as cluster performance loss, achieve the effects of improving performance, reducing network overhead, and ensuring scalability

Active Publication Date: 2018-11-16
SOUTH CHINA UNIV OF TECH
View PDF3 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, although Redis already has the current mainstream cluster solutions of Codis and Twemproxy in terms of distributed cluster solutions, these solutions use a proxy method to forward the client's request to cause the loss of cluster performance, and there are still de

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Redis clustering method based on ZooKeeper
  • Redis clustering method based on ZooKeeper
  • Redis clustering method based on ZooKeeper

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] The specific implementation of the present invention will be further described below in conjunction with the accompanying drawings, but the implementation and protection of the present invention are not limited to this. It should be pointed out that if there are any parts that are not specifically described in detail below, those skilled in the art can use the existing Technically understood or realized.

[0019] In this example, a Redis cluster method based on ZooKeeper is as follows figure 1 As shown, the following points will be explained in detail.

[0020] 1. Data fragmentation information maintenance

[0021] This example chooses to hand over the data fragmentation information to the third-party middleware ZooKeeper for maintenance, and uses the consistency provided by ZooKeeper to ensure that all clients can see consistent information. At the same time, the znode can be monitored to allow clients to be in the cluster topology. When the information changes, it can be no...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a Redis clustering method based on ZooKeeper. According to the method, the ZooKeeper is taken as consistency middleware to maintain data fragmentation information of a distributed Redis cluster, and a client acquires the data fragmentation information of the Redis cluster through the ZooKeeper and establishes a routing algorithm, so that the Redis client and a server can directly communicate without an agent layer, and the capabilities of dynamic capacity expansion and retraction and automatic data migration of the Redis cluster are achieved. Meanwhile, the method is combined with Redis-Sentinel and the ZooKeeper to achieve automatic transfer ability of cluster faults, and high availability of the Redis cluster is guaranteed. According to the method, the extra network expenditure brought by the agent layer of the Redis cluster is reduced, the performance of the Redis cluster is improved, and meanwhile, the expansion capability, the automatic data migration capability and the usability of the Redis cluster are ensured.

Description

Technical field [0001] The invention belongs to a cluster method in the field of distributed Key-Value systems, and particularly relates to a Redis cluster method based on ZooKeeper and its implementation. Background technique [0002] As a subset of Key-Value storage systems in NoSQL (Not Only Sql) databases, such as Redis, it uses a simple Key-Value data model and provides fast query operations similar to traditional Hash tables based on memory. They are usually used as an important means to improve the data access speed of data centers or applications, and have become an important part of key infrastructure in many data centers. In the industry, many large companies, such as Facebook, Amazon, etc., deploy large-scale distributed Key-Value system clusters as the data layer of key systems. It can be seen that the performance of these Key-Value storage systems will directly affect the QoS (Quality of Service) of many large-scale services. Improving the performance of the distrib...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08H04L12/24
CPCH04L41/0663H04L67/10H04L67/1095H04L67/562H04L67/563
Inventor 刘发贵周晓场
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products