Cloud Volume Restore with Lazy Data Retrieval and Source Switchover
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The restoration of a data volume from a backup image is often slow and inefficient due to network latencies and the need to transfer large amounts of data, causing users to lose valuable time while waiting for the volume to be restored.
Innovation Solution
A method that selects a first copy of a backup image from a remote server as the data source for the volume, retrieves missing data blocks, and then switches to a local copy of the backup image stored on a local storage device, allowing data to be retrieved on an as-needed basis and enabling immediate use of the volume while the remaining data is transferred in the background.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the backup image is transmitted from the remote backup server to the client computer system over the network, then the volume can be restored, but the restoration process is slow due to network latencies and large data transfer requirements
Solution Approach 1:
The system performs preliminary actions by maintaining a local cache of backup image data blocks at the client computer system before restoration is needed. When restoration is required, already-cached data blocks can be immediately used, eliminating the need to transfer them over the network during the restoration process.
Solution Approach 2:
The system implements local quality by caching frequently accessed or critical data blocks from the backup image locally at the client system. This ensures that essential data is available locally with high-speed access, while less critical data can be retrieved from the remote backup server when needed.
2Reliability
If the entire backup image is transmitted over the network before restoration, then complete volume recovery is achieved, but network bandwidth is consumed and restoration completion time increases
Solution Approach 1:
The system applies partial action by retrieving and caching only the specific data blocks that are actually needed for restoration, rather than transmitting the entire backup image. This selective approach reduces network bandwidth consumption and speeds up the restoration process while still achieving complete volume recovery.
Solution Approach 2:
The system enables self-service by automatically caching data blocks from the backup image during normal operations or in advance, so that when restoration is needed, the system can serve itself with locally-cached data without requiring extensive network transfers.
3Reliability
If data blocks are retrieved from the remote backup server during restoration, then the volume can be reconstructed, but network latency slows down the retrieval process
Solution Approach 1:
The system performs preliminary caching of backup image data blocks during normal operations or in advance of restoration needs. This preliminary action ensures that data blocks are already locally available when restoration begins, eliminating network latency during the critical restoration window.
Solution Approach 2:
The local cache acts as an intermediary between the remote backup server and the volume restoration process. Instead of directly retrieving data blocks from the remote server during restoration (which causes network latency), the system uses the local cache as a mediator to provide fast local access to cached data blocks.
Data Source
AI summary
Various embodiments of a system and method for restoring a data volume to a client computer system from a backup image are disclosed. A backup image at a remote backup server computer system may first be selected as a data source for the volume. The volume may be “instantly restored” on the client computer system without first requiring all of the data in the remote backup image to be transmitted from the backup server computer system. Instead, a lazy restore technique may be used where volume data is retrieved from the backup image on the backup server computer system as needed. Further embodiments of the system and method may enable the data source for the volume to be switched from the remote backup server computer system to a local data source at a later time.