Unlock instant, AI-driven research and patent intelligence for your innovation.

SFAD cuckoo filter and method for deleting duplicated data based on SFAD cuckoo filter

A deduplication and filter technology, which is applied in database indexing, electronic digital data processing, structured data retrieval, etc., can solve the problems of return deletion failure, dynamic adjustment of capacity characteristics, etc., to increase efficiency and throughput, The effect of reducing the false positive rate

Pending Publication Date: 2021-10-22
FOSHAN SAISICHAN TECH CO LTD +1
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

(5) If the same fingerprint is not found in this process, then return deletion failure
[0023] Although the SFA cuckoo filter can effectively reduce the false positive rate of the data structure, it does not have the feature of dynamically adjusting the capacity
In daily applications, the addition and deletion of data elements is very common, so the SFA cuckoo filter has certain limitations.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • SFAD cuckoo filter and method for deleting duplicated data based on SFAD cuckoo filter
  • SFAD cuckoo filter and method for deleting duplicated data based on SFAD cuckoo filter
  • SFAD cuckoo filter and method for deleting duplicated data based on SFAD cuckoo filter

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0064] Cuckoo Filter(CF) cuckoo filter

[0065] This program focuses on solving the problem that the SFA cuckoo filter cannot be dynamically expanded in the deduplication method. This program designs a data structure on the basis of the SFA cuckoo filter——SFAD cuckoo filter, which uses its own structure As well as the algorithm design, the function of distinguishing different data fingerprints is realized, and the capacity can be expanded independently.

[0066] As human beings enter the era of big data, the explosive growth of data on the entire Internet has brought huge challenges to data centers and various enterprises. Data deduplication technology can effectively eliminate redundant data in storage systems, reduce space overhead, bandwidth overhead, and energy consumption, and has become a research hotspot in the academic and industry circles. Block-level deduplication technology is widely used in various file systems because of its good balance between deduplication rat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention is suitable for the field of data processing technology improvement, and provides an SFAD cuckoo filter. The SFAD cuckoo filter is formed by connecting SFA cuckoo filters through a double linked list, and the SFAD cuckoo filter comprises a plurality of unit SFACFs, wherein each unit SFACF comprises a first unit CF pointer and a second unit CF pointer which are arranged in parallel. The SFAD cuckoo filter is an efficient summary data structure, and the false positive rate of the cuckoo filter is effectively reduced, so that the efficiency and throughput of a repeated data deletion system are improved.

Description

technical field [0001] The invention belongs to the field of data processing technology improvement, in particular to a SFAD cuckoo filter and a method for deleting duplicate data based on the SFAD cuckoo filter. Background technique [0002] With the rapid development of the Internet and the popularity of various Internet of Things and mobile terminal devices, people are now experiencing an era of information and data explosion. All kinds of Internet of Things devices such as cameras and sensors, as well as mobile terminal devices such as smart phones, smart watches, and smart bracelets, generate and receive massive amounts of data all the time. All times, human beings are entering the era of big data. Followed by the rapid growth of data scale, the storage scale of existing data centers has generally reached the PB level and is rapidly moving towards the EB level. Managing and maintaining the storage of massive data is a huge overhead for various data centers and storage...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/215G06F16/22G06F16/245
CPCG06F16/215G06F16/2228G06F16/245
Inventor 王博辉李挥杨昕蒋傅礼侯韩旭张华宇
Owner FOSHAN SAISICHAN TECH CO LTD