Tiered Storage Compression for Latency and SSD Endurance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
High-capacity data storage systems face inefficiencies in managing data access latency and storage space utilization due to the limitations of existing hierarchical storage tiering methods, which do not effectively differentiate between frequently and infrequently accessed data using on-drive and off-drive compression techniques.
Innovation Solution
Implementing a storage array with a tiering engine that promotes frequently accessed data to a fast tier with on-drive compression and less frequently accessed data to a slow tier with off-drive compression, optimizing data placement and storage efficiency by using on-drive compression logic for the fast tier and off-drive compression logic for the slow tier.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If data is stored on fast tier with on-drive compression, then data access latency is reduced, but storage space utilization decreases
Solution Approach 1:
The patent applies different compression strategies to different storage tiers based on their specific characteristics. The fast tier (SSD) uses on-drive compression to minimize write operations and extend endurance, while the slow tier (HDD) uses off-drive compression to maximize storage capacity. This localized quality adjustment resolves the contradiction by optimizing storage space utilization for each tier's specific requirements rather than applying a uniform compression approach.
2Quantity of substance
If data is compressed with off-drive compression logic, then storage space is optimized, but data access latency increases
Solution Approach 1:
The patent segments the storage system into two distinct tiers with different compression approaches. The fast tier uses on-drive compression that operates transparently during write operations without impacting read performance, while the slow tier uses off-drive compression that is applied asynchronously. This segmentation allows the system to optimize storage space on the slow tier without significantly impacting overall data access latency, as the majority of active data resides on the fast tier.
3Speed
If frequently accessed data is stored on fast tier, then data access latency is reduced, but wear on SSD increases
Solution Approach 1:
The patent converts the harmful effect of frequent writes to SSD into a benefit by implementing on-drive compression. The compression logic is integrated into the SSD controller, allowing data to be compressed before being written to the SSD medium. This reduces the total number of write operations required to store the same amount of uncompressed data, thereby extending SSD endurance while maintaining fast access latency for frequently accessed data.
4Reliability
If on-drive compression is used for fast tier, then SSD endurance is extended, but device complexity increases
Solution Approach 1:
The patent implements on-drive compression by integrating the compression logic directly into the SSD controller, allowing the SSD to perform compression operations autonomously without requiring host processor involvement. This self-service approach extends SSD endurance through compression while minimizing the impact on host system complexity, as the compression functionality is encapsulated within the SSD device itself.
Data Source
AI summary
In a storage system such as a SAN, NAS, or storage array that implements hierarchical performance tiers based rated drive access latency, on-drive compression is used on data stored on a first tier and off-drive compression is used on data stored on a second tier. Off-drive compression is more processor intensive and may introduce some data access latency but reduces storage requirements. On-drive compression is performed at or near line speed but generally yields lower size reduction ratios than off-drive compression. On-drive compression may be implemented at a higher performance tier whereas off-drive compression may be implemented at a lower performance tier. Further, space saving realized from on-drive compression may be applied to over-provisioning.