Distributed Storage Space Availability Notification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In distributed striped volume sets, existing storage systems face challenges in managing cross-stripe write operations due to varying storage space capacities among nodes, leading to potential write request rejections when some nodes lack sufficient space.
Innovation Solution
A method and system where a master data volume node periodically sends space availability detection messages to other nodes, allowing them to transition into low-in-space states if space is insufficient, thereby preventing further write operations until sufficient space is available, and utilizing reserved space for completing cross-stripe write operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If data is striped across multiple volumes in a distributed storage system, then data distribution and processing load are improved, but write request reliability deteriorates when some volumes lack sufficient space
Solution Approach 1:
The master data volume node sends space availability detection messages to all data volume nodes before routing write requests. This preliminary space check ensures that only volumes with sufficient available space are selected for receiving data stripes, preventing write request failures and maintaining reliability while preserving the benefits of distributed striping
2Device complexity
If space availability is not monitored across distributed volumes, then system complexity is reduced, but write operation reliability deteriorates due to potential space insufficiency
Solution Approach 1:
Data volume nodes periodically report their space availability status (available space, low-in-space state) back to the master data volume node in response to detection messages. This feedback mechanism enables the master node to make informed routing decisions without requiring complex distributed coordination, maintaining write operation reliability while keeping the system manageable
3Reliability
If all volumes must have sufficient space for a write operation, then data integrity is improved, but system adaptability deteriorates when some volumes are full
Solution Approach 1:
The system performs preliminary space availability checks on all candidate volumes before initiating a write operation. This allows the master node to identify and select only those volumes that can accommodate the data, dynamically adapting the striping distribution to current space conditions while ensuring data integrity by preventing writes to insufficient volumes
Data Source
AI summary
A computer data storage system is described. A processor maintains a striped volume set by striping a data container over a plurality of storage nodes. A storage node determines whether space available on that node is below a predetermined threshold, the predetermined threshold indicating a low-in-space state. The storage node sends a message indicating that the storage node is in a low-in-space state. The processor accepts no further write messages to the data container as long as the storage node is in a low-in-space state.