A redis cluster method based on zookeeper

Abstract

The invention discloses a ZooKeeper-based Redis cluster method. This method uses Zookeeper as the consistent middleware to maintain the data fragmentation information of the distributed Redis cluster. The client obtains the data fragmentation information of the Redis cluster through ZooKeeper and establishes a routing algorithm, so that the Redis client and the server are not connected. It needs to communicate directly through the proxy layer, and realize the dynamic expansion and contraction of the Redis cluster and the ability of automatic data migration. At the same time, this method combines Redis-Sentinel and ZooKeeper to realize the automatic transfer capability of cluster failures and ensure the high availability of Redis clusters. The invention reduces the extra network overhead brought by the agent layer of the Redis cluster, improves the performance of the Redis cluster, and at the same time ensures the expansion capability, automatic data migration capability and availability of the Redis cluster.

Description

technical field [0001] The invention belongs to a clustering method in the field of distributed Key-Value systems, and in particular relates to a ZooKeeper-based Redis clustering method and its realization. Background technique [0002] As a subset of the NoSQL (Not Only Sql) database, the Key-Value storage system, such as Redis, adopts a simple Key-Value data model and provides fast query operations similar to traditional Hash tables based on memory. They are usually used as an important means to improve the data access speed of data centers or applications, and have become an important part of the key infrastructure in many data centers. In the industrial world, many large companies, such as Facebook and Amazon, have deployed large-scale distributed Key-Value system clusters as the data layer of key systems. It can be seen that the performance of these Key-Value storage systems will directly affect the QoS (Quality of Service) of many large-scale services, and it is of gr...

AI Technical Summary

Problems solved by technology

However, although Redis already has the current mainstream cluster solutions of Codis and Twemproxy in terms of distributed cluster solutions, these solutions use a proxy method to forward the client's request to cause the loss of cluster performance, and there are still deficiencies. Therefore, the present invention Provides a ZooKeeper-based Redis cluster method, implements a higher performance and highly available distributed Redis cluster that supports online dynamic expansion and contraction, and can automatically perform data migration

Images