Distributed dynamic cuckoo filter system based on Redis cluster and filter method of system

Abstract

The invention provides a distributed dynamic cuckoo filter system based on a Redis cluster and a filter method of the system. The system comprises a Redis client, a DDCF (Distributed Dynamic Cuckoo Filter) system center module based on the Redis cluster and multiple DDCF system child nodes based on Redis cluster child nodes, wherein each DDCF system child node comprises one Redis cluster child node and a DCF. The invention furthermore provides an application method of the distributed dynamic cuckoo filter system based on the Redis cluster. The application method comprises a data interpositionmethod, a data query method and a data deletion method. According to the system and the method, through combination of an efficient data structure DCF and the distributed characteristic of the Redis cluster, retrieval performance of mass data in the Redis cluster is greatly improved, memory expenditure is remarkably lowered, and the utilization efficiency of storage space is greatly improved.

Description

technical field [0001] The invention relates to a distributed dynamic Rhododendron filtering system, which can be used to realize a large-scale, distributed high-performance massive data management platform, improve its data retrieval performance, and significantly reduce memory overhead, specifically a Redis cluster-based A distributed dynamic rhododendron filtering system belongs to the technical field of databases. Background technique [0002] Redis is an open source key-value storage system. Due to its outstanding performance, most Internet companies use it as server-side cache. Before version 3.0, Redis only supported single-instance mode. Although it supports master-slave mode and sentry mode deployment to solve single point of failure, it cannot meet the business needs at all in the face of massive data in the cloud era. Therefore, after version 3.0, Redis Cluster mode was introduced. [0003] The Redis cluster adopts the P2P model and is completely decentralized. ...

AI Technical Summary

Problems solved by technology

[0005] However, the above-mentioned various filters and their variants mostly exist in the form of stand-alone machines in real technology. Obviously, in the Redis cluster with a huge amount of data, the DCF of a single node can no longer meet our data retrieval needs, so It is expected to provide a solution that takes into account time and space efficiency and can efficiently retrieve massive data in Redis clusters

Images