Atomic Cross-Stripe Write Operations in Striped Volume Sets
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In storage systems, cross-stripe write operations across multiple volumes in a striped volume set (SVS) face challenges in ensuring data consistency, particularly when failures occur during processing, leading to potential inconsistencies in data storage.
Innovation Solution
The system employs a volume striping module (VSM) to acquire a range lock, record a persistent marker, and ensure that cross-stripe write operations are completed atomically by storing data on one volume before forwarding excess data to another, ensuring that either all or none of the data is persistently stored across stripes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If cross-stripe write operations are distributed across multiple volumes in a striped volume set, then storage capacity and I/O parallelism are improved, but data consistency and reliability deteriorate when failures occur during processing
Solution Approach 1:
The system performs preliminary actions by acquiring range locks on all stripes before writing data, and by pre-establishing the atomicity protocol. This ensures that when write operations are distributed across multiple volumes, the locks prevent concurrent conflicting operations and the protocol ensures that either all stripes are written successfully or none are, thereby maintaining data consistency while enabling parallel I/O operations.
2Reliability
If atomicity protocols are implemented for cross-stripe write operations, then data consistency is improved, but processing complexity and overhead increase
Solution Approach 1:
The system introduces an intermediary atomicity protocol that mediates between the distributed write operations and the consistency requirement. This protocol acts as a coordinator that manages the locking and commit process across stripes, simplifying the complexity by providing a standardized interface while ensuring data consistency through controlled access and atomic commit mechanisms.
3Reliability
If range locks are acquired for all stripes during cross-stripe writes, then data integrity is improved, but processing time and resource consumption increase
Solution Approach 1:
The system performs the locking action preliminarily, acquiring range locks on all target stripes before the actual write operation begins. This preliminary locking ensures data integrity by preventing conflicting operations, and it reduces overall processing time by establishing the protected state upfront rather than during the write process, allowing the actual data transfer to proceed without interruption.
Data Source
AI summary
A system and method performs cross stripe write operations to a striped volume set (SVS) comprising of a plurality of volumes. A cross stripe write operation is directed to a first volume striping module (VSM) serving a first data volume where the entire write data of the operation is written to the volume. The first VSM then forwards excess data that extends beyond the boundary of a stripe to a second VSM for storage on a second data volume.