Pool-Level SSD Storage Management for Cold Data Archiving
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current storage systems for cold data face challenges with the longevity and cost-effectiveness of storage media, particularly with HDDs and SSDs, where HDDs have short longevity and high operational costs, while SSDs have limited write capabilities and high read error rates, making them unsuitable for long-term archiving.
Innovation Solution
A management device is implemented to determine the status and cost of storage devices using a cost function that considers P/E cycles, block error states, and workload parameters, allowing for the selection of suitable SSDs, even those past their warranty, for archiving and error correction, thereby optimizing the use of storage devices and minimizing failure risks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If HDDs are used for cold storage, then storage capacity and cost-effectiveness are improved, but longevity and reliability deteriorate
Solution Approach 1:
The system dynamically monitors P/E cycle counts and operational status of each SSD in the pool, adjusting data placement and migration strategies in real-time based on current device health and remaining lifecycle, rather than using static allocation methods
Solution Approach 2:
The patent changes the operational parameters of SSDs by allowing them to operate beyond traditional warranty periods and expected P/E cycle limits through pool-level management, where individual device degradation is compensated by system-level redundancy and data migration strategies
2Speed
If SSDs are used for cold storage, then write capability and speed are improved, but longevity and read error rates worsen
Solution Approach 1:
The patent merges multiple SSDs into a pooled storage system where individual device weaknesses are compensated by collective strength, using aggregation of devices with varying P/E cycle counts to create a reliable storage pool
Solution Approach 2:
The system implements continuous feedback monitoring of P/E cycle counts and device health metrics, using this information to make informed decisions about data placement, migration timing, and device retirement to maintain overall system reliability
3Ease of manufacture
If SSDs past warranty are used for archiving, then cost is reduced, but reliability and data integrity worsen
Solution Approach 1:
The patent treats individual SSDs as consumable resources with finite lifespans, allowing their use past traditional warranty periods while managing risk through pool-level redundancy and systematic data migration before devices fail
Solution Approach 2:
The system performs preliminary data migration proactively based on monitored P/E cycle counts and device health indicators, moving data from devices approaching failure to healthier devices before actual failures occur, preventing data loss
Data Source
AI summary
A method of managing data storage using a management device that includes determining respective status information for a plurality of storage devices, and calculating, based on the status information, a respective cost for each of the plurality of storage devices using a cost function that includes one or more parameters including at least one of: a program/erase (P/E) parameter, a block error state parameter, a block error level parameter, and a workload parameter. The method further includes selecting a destination storage device of the plurality of storage devices based on at least some of the calculated costs, and writing data to the destination storage device.