Coordinated Dataset Checkpoints for Multi-Storage Replication
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing storage systems face inefficiencies in data management and reliability, particularly in handling flash storage devices, due to redundant processes and lack of direct control by the operating system, leading to increased latency and reduced reliability.
Innovation Solution
Implementing a direct-mapped flash storage system where the operating system directly addresses data blocks without translation by storage controllers, offloading device management tasks, and utilizing non-volatile RAM for quick data buffering and power failure protection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If storage controllers translate data blocks between host and device formats, then compatibility between different storage devices and hosts is improved, but latency increases due to the translation overhead
Solution Approach 1:
The patent creates a copy of the data block in the host format within the device's address space, allowing the host to access it directly without translation. This virtual copy eliminates the translation overhead while maintaining compatibility through the mapping relationship between device and host address spaces.
Solution Approach 2:
The patent introduces an address mapping mechanism that acts as an intermediary between host and device address spaces. This mapping layer allows direct host-formatted block access without requiring active translation by the storage controller during data operations.
2Reliability
If storage controllers manage device operations, then device coordination and error handling are improved, but the complexity of the storage system increases
Solution Approach 1:
The patent extracts the translation function from the storage controller, leaving the controller to focus only on device management and error handling. This separation reduces the controller's complexity while maintaining reliability through dedicated error handling capabilities.
Solution Approach 2:
The host system serves itself by directly accessing device blocks in host format through the mapped address space, eliminating the need for the storage controller to perform translation operations. The controller focuses on device management while the host handles its own data access needs.
3Speed
If data is buffered in volatile memory, then access speed is improved, but data loss occurs during power failures
Solution Approach 1:
The patent performs preliminary writing of data blocks to non-volatile storage media before the operation is considered complete. This ensures that data is safely persisted in the device's address space in host format, protecting against power failures while maintaining fast access through direct addressing.
Data Source
AI summary
Replicating multiple storage systems utilizing coordinated snapshots, including identifying a replica dataset stored across two or more target storage systems, wherein the replica dataset is a replication target for a source dataset stored across two or more source storage systems; identifying two or more local replicated checkpoints that are replicated from the two or more source storage systems to the two or more target storage systems, wherein two or more local source checkpoints for the two or more local replicated checkpoints are associated with a coordinated source checkpoint for the source dataset; and determining, based on the two or more local replicated checkpoints, a coordinated target checkpoint for the replica dataset.