Storage System Threshold Management for High-Speed Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing storage systems face challenges in managing storage devices with different access velocities to optimize performance, as they struggle to effectively utilize high-access-velocity devices for both writing and reading operations while maintaining data integrity and system efficiency.
Innovation Solution
A method and device that determine a threshold for data volume in high-access-velocity storage devices, prioritizing writes to these devices when spare space is available and using them for reads, while moving data to lower-access-velocity devices when space is limited, utilizing formulas to set thresholds based on write velocity and storage volume to optimize performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If data is written to high-access-velocity storage devices, then write performance is improved, but storage capacity is limited
Solution Approach 1:
The storage system is segmented into multiple storage devices with different access velocities (first storage device with higher velocity, second storage device with lower velocity). Data is segmented and distributed across these devices based on access patterns and thresholds, allowing the system to achieve high write performance for frequently accessed data while maintaining total storage capacity across all devices.
Solution Approach 2:
Different storage devices are assigned different local qualities (access velocities) to match different data access requirements. The first storage device provides high-speed access for hot data, while the second storage device provides lower-speed access for cold data, optimizing overall system performance while utilizing available capacity efficiently.
2Speed
If data is stored in high-access-velocity storage devices, then access velocity is improved, but storage volume is limited
Solution Approach 1:
The system adds another dimension to storage management by introducing multiple storage devices with different access velocities rather than relying on a single device. This dimensional expansion allows the system to provide high access velocity for frequently accessed data while maintaining total storage volume across the expanded storage hierarchy.
3Productivity
If the storage system uses multiple storage devices with different access velocities, then performance is improved, but device complexity increases
Solution Approach 1:
The system manages complexity by dynamically changing parameters such as data distribution thresholds and access velocity assignments based on workload characteristics. The controller adjusts data placement and access patterns according to predefined thresholds and access frequencies, optimizing performance while managing the complexity of multiple storage devices through adaptive parameter adjustment.
Data Source
AI summary
Storage systems are disclosed. For instance, a storage system comprises a first storage device of a first type and a second storage device of a second type, and the first storage device has a higher access velocity than the second storage device. A threshold indicating a volume limit of data stored in the first storage device can be determined. Data, which is specified by a write request for writing data to the storage system, is written to the first storage device in response to determining the data amount in the first storage device is lower than the threshold. A read request from a client device is processed based on data stored in the first storage device. Consequently, the first storage device with a higher access velocity in the storage system may be utilized as much as possible, so that storage device latency in the storage system is managed more effectively.