Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Fast comparison system for data blocks based on Bloom Filter

A technology for comparing systems and data, applied in electrical digital data processing, special data processing applications, instruments, etc., can solve problems such as system performance impact and system operating efficiency reduction, to improve comparison efficiency, improve operating efficiency, and reduce comparisons effect of time

Inactive Publication Date: 2009-12-23
LANGCHAO ELECTRONIC INFORMATION IND CO LTD
View PDF0 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the complexity of this HASH hash identification query is generally linear or logarithmic. That is to say, when the size of the data pool increases, the comparison efficiency of data blocks will gradually decrease. In the data deletion system, this will have a great impact on system performance, resulting in a reduction in system operating efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Fast comparison system for data blocks based on Bloom Filter
  • Fast comparison system for data blocks based on Bloom Filter

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0025] Such as figure 1 Shown, a kind of data block rapid comparison system based on Bloom filter of the present invention, its structure comprises data block comparison interface module, Bloom Filter data block comparison module, data block query comparison module, Bloom Filter metadata recording module and Data pool metadata record module; data block comparison interface module is connected to Bloom Filter data block comparison module, Bloom Filter data block comparison module is connected to data block query comparison module, Bloom Filter metadata record module and data pool metadata record module, data block query The comparison module is connected to the metadata record module of the data pool.

[0026] The data block comparison interface module provides an access interface for data block comparison, generates a data block identifier for the incoming data block to be compared, and passes the data block identifier to the Bloom Filter data comparison module; the BloomFilte...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a fast comparison system for data blocks based on a Bloom Filter, which belongs to fast comparison technology for data blocks. The structure of the fast comparison system comprises a data block comparison interface module, a Bloom Filter data block comparison module, a data block query comparison module, a Bloom Filter meta data recording module and a data pool meta data recording module. The fast comparison system for data blocks based on the Bloom Filter is used in a repeating data deleting system, utilizes the Bloom Filter to query whether a data block is in a data pool containing a large number of data blocks, replaces a huge amount of query comparison operation with computerizing operation to ensure that the comparison time of data blocks is irrelevant with the scale of the data pool, and effectively solves the problem of long comparison time of data blocks when the scale of the data pool is large, thereby improving the performances and the operating efficiency of the repeating data deleting system.

Description

technical field [0001] The invention relates to a data block rapid comparison technology, in particular to a data block rapid comparison system based on Bloom filter. Background technique [0002] In a data deduplication system, data block comparison is the most frequently used operation, because the most important job of deduplication is to compare a data block with all data blocks in the data pool to determine whether it already exists in the data pool. In the pool, if the data block already exists, the data block can be deleted conveniently, and a pointer pointing to the same data block in the data pool is kept, and if the data block does not exist, the data block is inserted into the data pool. [0003] The traditional data block comparison method generally adopts the data block HASH hash identification method, that is, a unique HASH hash is reserved for each data block in the data pool. When comparing data blocks, first calculate the HASH hash identifier of the data bl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 王文方
Owner LANGCHAO ELECTRONIC INFORMATION IND CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com