Redis clustering method based on ZooKeeper

Abstract

The invention discloses a Redis clustering method based on ZooKeeper. According to the method, the ZooKeeper is taken as consistency middleware to maintain data fragmentation information of a distributed Redis cluster, and a client acquires the data fragmentation information of the Redis cluster through the ZooKeeper and establishes a routing algorithm, so that the Redis client and a server can directly communicate without an agent layer, and the capabilities of dynamic capacity expansion and retraction and automatic data migration of the Redis cluster are achieved. Meanwhile, the method is combined with Redis-Sentinel and the ZooKeeper to achieve automatic transfer ability of cluster faults, and high availability of the Redis cluster is guaranteed. According to the method, the extra network expenditure brought by the agent layer of the Redis cluster is reduced, the performance of the Redis cluster is improved, and meanwhile, the expansion capability, the automatic data migration capability and the usability of the Redis cluster are ensured.

Description

Technical field [0001] The invention belongs to a cluster method in the field of distributed Key-Value systems, and particularly relates to a Redis cluster method based on ZooKeeper and its implementation. Background technique [0002] As a subset of Key-Value storage systems in NoSQL (Not Only Sql) databases, such as Redis, it uses a simple Key-Value data model and provides fast query operations similar to traditional Hash tables based on memory. They are usually used as an important means to improve the data access speed of data centers or applications, and have become an important part of key infrastructure in many data centers. In the industry, many large companies, such as Facebook, Amazon, etc., deploy large-scale distributed Key-Value system clusters as the data layer of key systems. It can be seen that the performance of these Key-Value storage systems will directly affect the QoS (Quality of Service) of many large-scale services. Improving the performance of the distrib...

AI Technical Summary

Problems solved by technology

However, although Redis already has the current mainstream cluster solutions of Codis and Twemproxy in terms of distributed cluster solutions, these solutions use a proxy method to forward the client's request to cause the loss of cluster performance, and there are still deficiencies. Therefore, the present invention Provides a ZooKeeper-based Redis cluster method, implements a higher performance and highly available distributed Redis cluster that supports online dynamic expansion and contraction, and can automatically perform data migration

Images