Dynamic Block File System Ownership Transfer for Load Balancing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In storage systems employing block file systems, high redirection of storage requests between multiple storage processors can lead to performance issues and resource wastage, particularly when different logical units share a file system and are exposed via different processors.
Innovation Solution
Implement a method where storage requests are redirected to the owning storage processor, and if the redirection exceeds a predetermined threshold, the file system is dynamically transferred to another processor with higher request processing capacity, effectively balancing the load and reducing internal request transfers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If storage requests are redirected to the owning storage processor, then file system operations can be processed locally, but high redirection rates cause performance degradation and resource wastage
Solution Approach 1:
The patent implements dynamic load balancing by allowing any storage processor to become the owning processor for a file system based on current load conditions. The system continuously monitors redirection rates and dynamically transfers file system ownership to the storage processor with the lowest current load, rather than maintaining static ownership. This dynamic approach ensures that file system operations are always handled by the least busy processor, minimizing redirection latency and maximizing processing efficiency.
Solution Approach 2:
The system employs feedback mechanisms by continuously monitoring the redirection rate and load conditions across storage processors. When the redirection rate exceeds a threshold or when load imbalance is detected, the system automatically triggers a file system transfer to a different storage processor. This closed-loop feedback ensures that the system adapts to changing workloads and maintains optimal performance by reducing unnecessary redirections.
2Productivity
If file system ownership is transferred frequently to balance load, then redirection is minimized, but system complexity and transfer overhead increase
Solution Approach 1:
The patent applies partial action by implementing transfer thresholds that prevent overly frequent file system transfers. Instead of transferring ownership with every load imbalance, the system only triggers transfers when redirection rates exceed defined thresholds or when load differences meet specific criteria. This selective approach balances load effectively while avoiding the overhead and complexity associated with excessive transfers, maintaining system stability while improving throughput.
3Productivity
If multiple storage processors share access to a file system, then load can be distributed, but redirection operations consume additional system resources
Solution Approach 1:
The system implements self-service by having storage processors automatically monitor their own load conditions and participate in load balancing decisions without requiring centralized control. Each storage processor tracks its own workload and can voluntarily offer to become the owning processor for a file system when it detects that it has lower load than current owners. This self-organizing approach distributes the load balancing burden across all processors, reducing the resource overhead associated with centralized redirection management while maintaining high handling capacity.
Data Source
AI summary
A storage system uses a block-level file system to manage physical storage of data blocks of logical units, the file system being mounted on an owning one of a set of storage processors. The storage processors redirect received storage requests to the owning storage processor, and periodically the amount of redirection is evaluated. If the amount of redirection is higher than a threshold, then the file system is dismounted at the owning storage processor and mounted at another storage processor to reduce the amount of redirection.