System-Wide Storage Deduplication Across Multiple Apparatuses
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional deduplication technology is limited to within individual storage apparatuses, leading to inefficiencies in capacity usage across multiple storage apparatuses in a system environment, such as a data center, where duplicate data may exist on multiple devices, hindering system-wide capacity optimization.
Innovation Solution
A storage system and method that calculate data capacity reductions across multiple storage apparatuses by identifying optimal combinations for deduplication, allowing for the removal of duplicate data across the entire system, thereby improving overall storage capacity efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If deduplication technology is applied only within individual storage apparatuses, then the implementation complexity is low, but the volume capacity usage efficiency across the system is insufficient
Solution Approach 1:
The patent merges deduplication operations across multiple storage apparatuses by introducing a storage system-level deduplication mechanism. The management apparatus coordinates deduplication across plurality of storage apparatuses, allowing duplicate data to be identified and eliminated system-wide rather than within individual devices, thereby improving overall volume capacity usage efficiency
Solution Approach 2:
The storage system implements a universal deduplication framework that operates across different storage apparatuses with diverse data types and formats. The management apparatus provides multi-functional capabilities including cross-apparatus deduplication coordination, data capacity calculation, and optimal arrangement determination, making the system adaptable to various storage environments
2Quantity of substance
If deduplication is performed across multiple storage apparatuses, then the volume capacity usage efficiency improves, but the calculation complexity for optimal arrangement increases
Solution Approach 1:
The patent segments the complex cross-apparatus deduplication problem into manageable parts. Each storage apparatus independently calculates its own data capacity and identifies duplicate data locally, then reports findings to the management apparatus. This segmentation reduces overall calculation complexity while achieving system-wide deduplication effects
Solution Approach 2:
The system performs preliminary calculations of data capacity and duplicate identification at each storage apparatus before central coordination. By pre-calculating local deduplication potential and preparing data capacity information in advance, the management apparatus receives processed information that reduces the complexity of subsequent system-level optimization calculations
Data Source
AI summary
Provided is a storage system and a data management method of a storage system enabling system-wide data deduplication. The storage system has a plurality of storage apparatuses in which one or a plurality of logical volumes are provided. Based on data information of data obtained through the generation of a request to write to a logical volume in the storage system, one storage apparatus among the plurality of storage apparatuses calculates, for a plurality of combinations of storage apparatus and logical volume in the storage system, a data capacity when duplicate data is removed for each of the storage apparatuses, calculates the total of the calculated data capacities as the total capacity of the whole storage system, and performs optimal arrangement arithmetic processing to output information indicating a combination with the smallest total capacity among the plurality of combinations.