Deduplication Storage Capacity Management via Logical Partitioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Deduplication storage systems face challenges in accurately reporting capacity due to dynamic deduplication ratios, which affect the actual system capacity and require flexible partitioning that accounts for changing data patterns, but existing methods based on physical partitioning fail to adapt effectively to these changes.
Innovation Solution
The solution involves computing and reporting capacity based on an expected deduplication ratio, which is a combination of the current and configured ratios, allowing for logical partitioning of storage units that fluctuate with changes in deduplication ratios, ensuring accurate capacity reporting and flexible management.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If physical partitioning is used to divide storage capacity, then the storage system can be organized into defined portions, but the partitioning cannot adapt to changes in deduplication ratio and loses flexibility
Solution Approach 1:
The patent implements dynamic partitioning where storage portions are not fixed physically but are defined logically and can change size automatically in response to deduplication ratio changes. The system continuously monitors deduplication performance and adjusts portion boundaries dynamically, allowing the partitioning structure to adapt to varying data patterns and deduplication effectiveness without requiring system scans or manual reconfiguration.
Solution Approach 2:
The system changes the parameter of partition definition from fixed physical boundaries to flexible logical boundaries based on deduplication ratio thresholds. When deduplication performance changes, the system adjusts the capacity allocation of different portions by modifying the deduplication ratio parameters rather than physically moving data, enabling adaptive partitioning that responds to changing data characteristics.
2Measurement precision
If deduplication ratio is used to determine actual system capacity, then capacity reporting becomes more accurate from user perspective, but capacity calculation becomes more complex and dynamic
Solution Approach 1:
The system implements feedback mechanisms that continuously monitor actual deduplication ratios achieved and use this information to adjust capacity reporting and portion definitions. The capacity management system receives feedback on deduplication performance and automatically adjusts the expected deduplication ratios used in capacity calculations, creating a closed-loop system that improves accuracy while automating the complexity of dynamic calculations.
Solution Approach 2:
The system performs preliminary actions by pre-defining multiple portions with different expected deduplication ratios before data is stored. This allows the system to proactively organize storage capacity according to anticipated deduplication behavior for different data types, sources, or time periods, enabling accurate capacity planning without waiting for actual deduplication results to determine partitioning.
3Ease of operation
If physical storage capacity is reported, then the reporting is simple and based on physical entities, but it does not accurately reflect the actual usable capacity considering deduplication effects
Solution Approach 1:
The patent introduces an intermediary layer between physical storage and user-facing capacity reporting. This intermediary layer translates physical storage capacity into logical capacity that reflects actual usable space after deduplication. The system maintains portion definitions that act as intermediaries, mapping physical storage resources to logical capacity units that automatically account for deduplication effects, thereby preserving simplicity while improving accuracy.
Data Source
AI summary
A deduplication storage capacity is estimated as a function of an expected deduplication ratio, the expected deduplication ratio being a combined average of a current deduplication ratio and a configured deduplication ratio, the current deduplication ratio depending on the data currently stored in the deduplication storage, and the configured deduplication ratio being an estimate made at a configuration stage of the deduplication computing storage environment.