Storage System Background Operation Throttling for I/O Response Stability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current storage systems face challenges in dynamically adjusting system resources for background operations, leading to spikes in I/O response time and CPU utilization, especially under variable workloads and complex application environments, which is unacceptable for response time-sensitive applications.
Innovation Solution
A method and device for operation control in a storage system that dynamically adjusts background operations by obtaining performance parameters such as access response time and resource utilization, determining a scheduling parameter based on target performance parameters, and using it to control the execution of background operations, such as sleep time and thread number, to throttle operations effectively.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If background operations are executed without throttling, then productivity of background operations is improved, but I/O response time and CPU utilization spike excessively
Solution Approach 1:
The patent implements dynamic throttling of background operations by adjusting the execution speed of background tasks based on real-time system load conditions. The controller monitors system resources and dynamically modifies the rate at which background operations proceed, transforming a static execution model into a dynamic one that adapts to changing system states, thereby preventing response time spikes while maintaining productivity.
Solution Approach 2:
The system employs feedback mechanisms where the controller continuously monitors system performance metrics (such as I/O response time and CPU utilization) and uses this feedback to adjust the throttling level of background operations. This closed-loop control ensures that background operations are slowed down when system load is high and can proceed faster when resources are available, resolving the contradiction between productivity and response time.
2Stability of the object's composition
If throttling parameters are increased to control background operations, then I/O response time stability is improved, but system complexity increases due to multiple throttling factors
Solution Approach 1:
The patent changes the parameters controlling background operations from multiple independent throttling factors to a unified set of parameters based on system load conditions. By modifying the control parameters to be load-dependent rather than fixed or multi-factorial, the system achieves response time stability while reducing the effective complexity of the throttling mechanism.
Solution Approach 2:
The controller serves multiple functions: it monitors system load, determines appropriate throttling levels, and adjusts background operation execution. This multi-functional approach consolidates what would otherwise require separate complex parameter management systems into a single universal controller, reducing overall system complexity while maintaining stability.
3Loss of time
If aggressive throttling is applied to background operations, then I/O response time is maintained, but execution speed of background operations decreases significantly
Solution Approach 1:
The throttling level is made dynamic rather than fixed or aggressively constant. The controller adjusts the throttling intensity in real-time based on actual system conditions, allowing background operations to execute at high speed when resources are available and applying gentle throttling only when necessary to maintain response time, thus avoiding significant productivity loss.
Solution Approach 2:
Instead of applying full throttling continuously, the system applies partial throttling only to the extent necessary to maintain I/O response time within acceptable bounds. This partial action approach ensures that background operations proceed as fast as possible without excessively impacting response time, optimizing the trade-off between the two competing objectives.
Data Source
AI summary
Techniques perform operation control in a storage system. The techniques involve obtaining a performance parameter of the storage system. The performance parameter is associated with at least one of access response time and resource utilization of the storage system. The techniques further involve obtaining a target performance parameter. The target performance parameter indicates a desired value of the performance parameter. The techniques further involve: in response to the performance parameter exceeding a first threshold, determining a scheduling parameter based on the performance parameter and the target performance parameter. The scheduling parameter is used to control execution of background operations in the storage system. In accordance with at least some of the techniques, background operations in the storage system can be effectively controlled, so that the resource usage and input/output performance can be improved.