Dynamic QOS Management in Distributed Storage Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In traditional distributed storage systems, it is difficult to dynamically manage quality of service (QOS) as it is typically fixed based on hardware components, making it challenging to meet specific QOS requests from clients, especially under service level agreements (SLAs).
Innovation Solution
A distributed storage system with a performance management server that dynamically adjusts hardware and software parameters of compute and storage nodes to match requested QOS by provisioning resources and controlling data placement based on performance capabilities of SSDs and HDDs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If QOS capabilities are fixed based on hardware components in a storage cluster, then system simplicity is maintained, but the ability to meet specific QOS requests from clients is compromised
Solution Approach 1:
The system dynamically adjusts QOS parameters by modifying hardware and software settings of compute and storage nodes in real-time based on client requests and current system conditions, transitioning from static fixed QOS to dynamic adaptable QOS management
Solution Approach 2:
The system changes physical and operational parameters of storage devices (such as caching policies, data placement strategies, and device operational modes) to adjust QOS characteristics, enabling flexible QOS delivery without changing the underlying hardware configuration
2Productivity
If data object placement is determined based on available storage capacity, then storage utilization is optimized, but performance capabilities of various data storage devices are not considered
Solution Approach 1:
The system applies different data placement strategies to different storage devices based on their specific performance characteristics and capabilities, placing performance-sensitive data objects on high-performance devices while maintaining overall storage utilization efficiency
Solution Approach 2:
The system continuously monitors the performance and status of storage devices, using this feedback information to dynamically adjust data object placement decisions to maintain both storage utilization and QOS guarantees
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Technologies for providing dynamically managed quality of service in a distributed storage system include an apparatus having a processor. The processor is to determine capabilities of one or more compute devices of the distributed storage system. The processor is also to obtain an indicator of a target quality of service to be provided by the distributed storage system, determine target performance metrics associated with the target quality of service, determine target configuration settings for the one or more compute devices of the distributed storage system to provide the target quality of service, configure the one or more compute devices with the target configuration settings, determine whether a present performance of the distributed storage system satisfies the target quality of service, and reconfigure the one or more compute devices in response to a determination that the target quality of service is not satisfied. Other embodiments are described and claimed.