Storage Data Recovery via Cloud Change Streams
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional storage systems face inefficiencies in data management and reliability due to unnecessary write operations and lack of centralized control, leading to reduced reliability and increased latency.
Innovation Solution
Implementing a direct-mapped flash storage system where the operating system initiates and controls data operations, offloading device management from storage drives, and utilizing non-volatile RAM as a buffer to improve write latency and reliability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If storage drives perform device management operations, then data operations can be executed, but write latency increases and reliability decreases due to redundant operations
Solution Approach 1:
The patent extracts device management functions from storage drives and consolidates them into a dedicated device manager component within the operating system. This separation allows storage drives to focus solely on data operations while the device manager handles metadata management, write caching, and coordination, thereby eliminating redundant operations and reducing write latency.
Solution Approach 2:
The device manager acts as an intermediary between the operating system and storage drives. It receives write requests, manages the write cache in non-volatile RAM, coordinates with flash translation layers, and handles metadata operations. This intermediary layer optimizes data flow and prevents redundant operations between multiple components.
2Ease of operation
If multiple components manage data operations independently, then data can be stored, but system complexity increases and control is fragmented
Solution Approach 1:
The patent merges device management functions that were previously distributed across storage drives into a single centralized device manager within the operating system. This consolidation provides unified control over metadata management, write caching, and coordination of data operations across multiple storage drives, simplifying the system architecture while maintaining operational ease.
3Productivity
If write operations are performed directly to flash drives, then data is stored, but unnecessary redundant writes reduce efficiency
Solution Approach 1:
The system performs preliminary actions by buffering write operations in non-volatile RAM before committing them to flash storage. The device manager coordinates write requests, batches operations when possible, and manages the write cache to minimize redundant writes to flash drives, thereby improving productivity and reducing unnecessary energy consumption.
Data Source
AI summary
A method for storage system reliability using data recovery as a service, the method including: receiving, for storage data on a storage system, a specification for a particular recovery time objective (“RTO”) and recovery point objective (“RPO”) setting among a plurality of options for RTO/RPO settings; generating, in accordance with the particular RTO/RPO setting, a change stream of data in response to receiving data to be stored on the storage system; and transmitting, from the storage system to a cloud data recovery as a service endpoint, the change stream of data from which data on the storage system may be recovered up to a point in time corresponding to the particular RPO setting and within a time period corresponding to the particular RTO setting.