A Fast Duplicate Data Block Identification Method Based on 3D Stacked Memory

An identification method and a technology for repeating data, applied in the direction of electrical digital data processing, data processing input/output process, instruments, etc., can solve the problem of fingerprint time overhead, etc., to achieve reduced time, avoid data movement, and avoid communication overhead. Effect

Active Publication Date: 2020-05-19
HUAZHONG UNIV OF SCI & TECH
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of the defects of the prior art, the purpose of the present invention is to solve the technical problems of time overhead and energy consumption caused by the continuous movement of fingerprints during the fingerprint retrieval process of the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Fast Duplicate Data Block Identification Method Based on 3D Stacked Memory
  • A Fast Duplicate Data Block Identification Method Based on 3D Stacked Memory
  • A Fast Duplicate Data Block Identification Method Based on 3D Stacked Memory

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.

[0037] figure 1 It is a schematic diagram of the system architecture of the present invention. Such as figure 1 As shown, the system architecture includes a CPU 10 , a crossbar switch 20 and a 3D stacked memory (3D Stacked Memory) 30 . In this architecture, the CPU 10 communicates with the 3D stack memory 30 through the crossbar switch 20 . In order to enable memory to provide higher bandwid...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a fast repetitive data block identification method based on 3D stacked memory. The method comprises the following steps: sending a data block fingerprint to a 3D stacked memory; Searching and storing the fingerprints of the data blocks in the 3D stack memory; returning fingerprint retrieval results to that CPU by the 3D stack memory. The 3D stack memory is used to store data block fingerprints, 3D stack memory is formed by stacking a plurality of DRAM chips and a logic layer chip, and is connected through TSV technology. That logic layer accesses the memory layer through TSV without passing through a data bus, the speed is fast, unnecessary data movement on the bus is avoided, and the time for accessing the memory is reduced; The invention classifies the data fingerprints, divides the memory chip, stores each class of fingerprints in one division, embeds a plurality of calculation units and a route in the logic layer, and routes the data fingerprints to each calculation unit, avoids the communication overhead between the calculation units, and reduces the energy consumption in the fingerprint search process.

Description

technical field [0001] The invention belongs to the technical field of computer storage, and more specifically relates to a method for quickly identifying repeated data blocks based on 3D stacked memory. Background technique [0002] Data deduplication is a redundant data elimination technology, which can effectively reduce the storage scale of data, save storage space, and reduce energy consumption of data centers. The deduplication process includes data block, fingerprint calculation, and fingerprint retrieval. Among them, fingerprint retrieval judges whether the corresponding data block is duplicated by checking whether the fingerprint exists in the index, which is one of the key steps in the data deduplication process. [0003] In a mass data storage system, index access can only be performed in the main memory, but the fingerprint index generated by mass data is huge, and part of the index has to be stored in the hard disk. In order to improve the retrieval speed of fi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/0641G06F3/0676
Inventor 曾令仿程稳蔡苒李春艳桑大邹王芳冯丹
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap