Data processing method based on discrete double-fingerprint storage cuckoo filter

Abstract

The invention discloses a data processing method based on a discrete double-fingerprint storage cuckoo filter. The data processing method comprises steps that a main index table based on the discrete double-fingerprint storage cuckoo filter is established and initialized; data insertion, data query and / or data deletion are correspondingly performed according to the current instruction type; whether the current instruction type continues to be obtained or not is judged, if yes, data processing continues to be carried out, and if not, data processing of the discrete type double-fingerprint storage cuckoo filter is ended. The method is advantaged in that dynamic expansion and contraction of the storage space of the cuckoo filter are realized by combining dynamic transformation of the storage space and dynamic increase and decrease of the storage data, and the construction speed of a data structure is increased; the storage space is saved, accuracy of member query is improved, and the probability of mistakenly deleting the members is reduced; a problem of circular filling during data relocation operation is effectively avoided, and use efficiency of the cuckoo filter is improved.

Description

technical field [0001] The invention relates to the fields of computer information representation and information retrieval, in particular to a data processing method based on a discrete double-fingerprint storage cuckoo filter. Background technique [0002] "Correctly determine whether a member is in a huge set", "whether a member can be correctly deleted in a huge set" and "whether a member can be successfully inserted in a huge set", these three questions are three It is a common data processing problem, especially to deal with the above problems under several key requirements such as low storage space overhead and fast query. The realization of these problems has become a huge challenge. At present, researchers generally use Bloom filter (Bloom Filter), Bloom filter and its variants, cuckoo filter (Cuckoo Filter) and variants of cuckoo filter to solve the above problems, but for Bloom filter ( Bloom Filter) including its variants, can no longer adapt to and solve the ab...

AI Technical Summary

Problems solved by technology

[0003] Aiming at the above-mentioned deficiencies in the prior art, the data processing method based on the discrete double fingerprint storage cuckoo filter provided by the present invention solves the inability of the prior art to simultaneously Adapt to dynamic and high-speed data conversion, reliable data insertion, and high probability of data cyclic filling

Images