A Fast Duplicate Data Block Identification Method Based on 3D Stacked Memory

Abstract

The invention discloses a fast repetitive data block identification method based on 3D stacked memory. The method comprises the following steps: sending a data block fingerprint to a 3D stacked memory; Searching and storing the fingerprints of the data blocks in the 3D stack memory; returning fingerprint retrieval results to that CPU by the 3D stack memory. The 3D stack memory is used to store data block fingerprints, 3D stack memory is formed by stacking a plurality of DRAM chips and a logic layer chip, and is connected through TSV technology. That logic layer accesses the memory layer through TSV without passing through a data bus, the speed is fast, unnecessary data movement on the bus is avoided, and the time for accessing the memory is reduced; The invention classifies the data fingerprints, divides the memory chip, stores each class of fingerprints in one division, embeds a plurality of calculation units and a route in the logic layer, and routes the data fingerprints to each calculation unit, avoids the communication overhead between the calculation units, and reduces the energy consumption in the fingerprint search process.

Description

technical field [0001] The invention belongs to the technical field of computer storage, and more specifically relates to a method for quickly identifying repeated data blocks based on 3D stacked memory. Background technique [0002] Data deduplication is a redundant data elimination technology, which can effectively reduce the storage scale of data, save storage space, and reduce energy consumption of data centers. The deduplication process includes data block, fingerprint calculation, and fingerprint retrieval. Among them, fingerprint retrieval judges whether the corresponding data block is duplicated by checking whether the fingerprint exists in the index, which is one of the key steps in the data deduplication process. [0003] In a mass data storage system, index access can only be performed in the main memory, but the fingerprint index generated by mass data is huge, and part of the index has to be stored in the hard disk. In order to improve the retrieval speed of fi...

AI Technical Summary

Problems solved by technology

[0004] In view of the defects of the prior art, the purpose of the present invention is to solve the technical problems of time overhead and energy consumption caused by the continuous movement of fingerprints during the fingerprint retrieval process of the prior art

Images