Storage Deduplication Mapping with Aggregation Addresses
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing deduplication methods in storage devices require a large amount of memory space to maintain mapping relationships, which can lead to inefficiencies in data storage and management.
Innovation Solution
A deduplication method that contiguously stores data blocks and their metadata in specific sequences of logical addresses, reducing the number of mapping entries by using an aggregation address that includes a physical address and an address identifier of metadata, thereby saving memory space and facilitating metadata deletion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional deduplication mapping relationships are maintained in storage devices, then data integrity and accessibility are ensured, but memory space is excessively occupied
Solution Approach 1:
The patent combines multiple mapping relationships (logical address to physical address, logical address to fingerprint, and fingerprint to physical address) into a single aggregated mapping entry. Instead of maintaining three separate mappings, the system creates one unified mapping that stores the logical address, aggregation physical address, and fingerprint together, reducing memory space while preserving all necessary data integrity information.
Solution Approach 2:
The patent segments the mapping information into distinct components within an aggregated structure. Each mapping relationship is divided into specific fields (logical address, aggregation physical address, fingerprint) that can be independently accessed and managed, allowing the system to maintain data integrity while reducing overall memory consumption through consolidated storage.
2Ease of operation
If comprehensive mapping relationships are maintained for each data block, then data accessibility is improved, but device complexity increases
Solution Approach 1:
The patent merges multiple complex mapping relationships into a single simplified aggregated mapping entry. By combining logical address, physical address, and fingerprint information into one unified structure, the system reduces the complexity of mapping relationship management while maintaining full data accessibility through the consolidated entry.
3Quantity of substance
If deduplication is performed on all data blocks, then storage space is optimized, but processing time increases
Solution Approach 1:
The patent extracts only the essential fingerprint information from each data block for deduplication comparison, rather than processing the entire data block. By calculating and comparing only the fingerprint (a condensed representation), the system achieves effective deduplication while significantly reducing processing time and computational overhead.
Data Source
AI summary
The present disclosure directs to solutions for performing deduplication by a storage device. In the solutions, according to a duplicate data locality principle, non-duplicate data blocks whose logical addresses are contiguous are stored in contiguous physical addresses in a sequence of the logical addresses, and fingerprints of the non-duplicate data blocks whose logical addresses are contiguous are also stored in contiguous physical addresses in the sequence of the logical addresses, and in addition, a mapping from a logical address, which is of one data block in the non-duplicate data blocks whose logical addresses are contiguous, to an aggregation address is established.