Dynamic RAID Destaging with Secondary Storage Fallback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Distributed storage systems face challenges in efficiently destaging data when primary storage devices become unavailable, leading to increased latency and potential system failures due to the lack of mechanisms for handling unavailability in RAID 1 configurations.
Innovation Solution
The method involves detecting a destage event and issuing primary write requests to multiple primary storage devices, with secondary write requests directed to different secondary storage devices if primary requests fail, and updating a bitmap to track storage devices where the data is stored, ensuring data redundancy and faster destaging.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is stored only on primary storage devices in RAID 1 configuration, then data redundancy is maintained, but system reliability deteriorates when primary devices become unavailable
Solution Approach 1:
The patent pre-allocates secondary storage devices as backup destinations before primary storage devices fail. When a destage event occurs, the system attempts to write to primary devices first, and only if those fail does it automatically redirect to pre-identified secondary devices. This preliminary preparation of backup paths eliminates the need to reactively search for alternative storage locations during failures, thereby maintaining reliability without compromising adaptability.
Solution Approach 2:
The patent introduces secondary storage devices as intermediary backup targets between the journal and primary storage devices. These secondary devices act as mediators that receive data items when primary devices are unavailable, preventing system failures while maintaining the primary RAID 1 mirroring structure. The intermediary secondary devices bridge the gap between journal and primary storage during failure conditions.
2Loss of time
If the system waits for primary storage devices to become available before destaging, then data consistency is maintained, but destaging latency increases
Solution Approach 1:
The patent implements a dynamic destaging strategy that adapts the write destination based on real-time availability of storage devices. The system dynamically switches between primary and secondary storage devices depending on which are currently available, rather than statically waiting for primary devices. This dynamic approach reduces destaging latency while maintaining data consistency through the use of bitmaps to track successful writes.
Solution Approach 2:
The patent changes the parameter of write destination from fixed (primary devices only) to variable (primary or secondary devices based on availability). By monitoring device availability status and changing the destination parameter dynamically, the system achieves faster destaging without compromising data consistency, as the bitmap tracking ensures proper replication state maintenance.
3Adaptability or versatility
If secondary storage devices are used as backup destinations, then system adaptability improves, but device complexity increases
Solution Approach 1:
The patent segments the storage system into distinct roles: primary storage devices for normal operation and secondary storage devices for backup. This segmentation allows the system to maintain simple RAID 1 mirroring to primary devices while adding secondary devices as a separate, optional layer. The segmentation isolates the complexity to only the necessary extent, allowing secondary devices to be added without fundamentally changing the core RAID 1 structure.
Solution Approach 2:
The patent makes secondary storage devices multi-functional: they serve as backup destinations for failed primary devices, and can potentially serve as primary devices themselves if the system reconfigures. This universality allows the system to handle device failures gracefully while maintaining a relatively simple overall structure, as the same secondary devices can fulfill multiple potential roles without requiring dedicated complex failover mechanisms.
Data Source
AI summary
A method is disclosed for destaging data to a storage device set that is arranged to maintain M replicas of the data, the storage device set having M primary storage devices and N secondary storage devices, the method comprising: detecting a destage event; and in response to the destage event, destaging the data item that is stored in a journal, the destaging including: issuing M primary write requests for storing the data item, each of the M primary write requests being directed to a different one of the M primary storage devices; in response to detecting that L of the primary write requests have failed, issuing L secondary write requests for storing the data item, each of the L secondary write requests being directed to a different secondary storage device; updating a bitmap to identify all primary and secondary storage devices where the data item has been stored.