Distributed Bloom filter system and application method thereof

A filtering system and distributed technology, applied in the computer field, can solve problems such as the inability to quickly retrieve and query massive data, and achieve the effects of fast retrieval speed, good scalability, and low storage space requirements

Active Publication Date: 2012-07-25
XIAMEN MEIYA PICO INFORMATION
View PDF5 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of this, the present invention provides a distributed Bloom filtering system and its usage method to solve the shortcoming that the single-subnode Bloom filter in the prior art cannot realize fast retrieval and query of massive data, and the solution provided by the present invention can

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed Bloom filter system and application method thereof
  • Distributed Bloom filter system and application method thereof
  • Distributed Bloom filter system and application method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] Embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0031] figure 1 Shown is a distributed Bloom filter system provided by the embodiment of the present invention, including a distributed Bloom filter system master control module 1 and several sub-nodes 2, the sub-node 2 is the real entity of the Bloom filter, and several sub-nodes 2 form a Closed loop, the main control module 1 of the distributed Bloom filtering system is independent of the ring, the main control module 1 of the distributed Bloom filtering system is used to complete the calculation of the first hash of the current input data and the mapping of the current input data to the child nodes, The child node 2 is used to complete the second hash calculation of the current input data and corresponding data query, wherein the corresponding data query refers to data query, insertion and removal.

[0032] like figure 1 As shown in , the main con...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a distributed Bloom filter system, which comprises a main control module of the distributed Bloom filter system and a plurality of child nodes. The child nodes are Bloom filters. The child nodes form a closed loop and the main control module of the distributed Bloom filter system is disposed outside the closed loop independently. The main control module of the distributed Bloom filter system is used for finishing first hash calculation of current input data and mapping the current input data to the child nodes. The child nodes are used for finishing second hash calculation of the current input data and implementing data query of the current input data according to results of the second hash calculating. The distributed Bloom filter system and an application method thereof are fast in searching speed, high in precision, fine in augmentability, low in characteristic value storage space requirement, and particularly suitable for resource and information searching in an era of cloud computing.

Description

technical field [0001] The invention relates to computer technology fields such as information retrieval and filtering, cloud computing, and distributed computing, and in particular to a distributed Bloom filtering system and a method for using the same. Background technique [0002] With the development of Internet technology, resource sharing and data interaction need to be realized all the time. Distributed technology and cloud computing technology are the development trend and research hotspot of Internet technology today. When sharing resources, we often need to judge whether a certain table item is included in a data set, for example: in a web crawler, whether a website has been visited; for the visit statistics of a website, whether the current connection IP has come to visit And so on, which requires a resource query or information retrieval. [0003] In the information processing process of resource query, which search method to use depends on the information repre...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 汤伟宾罗佳张永光
Owner XIAMEN MEIYA PICO INFORMATION
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap