Virtualized Backup System Chunk-Based Restore Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data backup, archive, and restore processes are inefficient due to unnecessary creation of duplicate copies, leading to increased storage requirements, network traffic, and prolonged restore times, especially over low-bandwidth connections.
Innovation Solution
A system and method that utilize a backup server to monitor files across multiple hosts, identify unique copies, and perform chunk-based backups and restores, where only unique files are backed up and restored from multiple sources over a network, distributing the load and reducing bandwidth bottlenecks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional backup systems create copies of data on multiple systems, then data protection and availability are improved, but storage requirements and network traffic increase significantly
Solution Approach 1:
The patent uses virtual copies of data blocks stored in a virtualized storage system. Instead of physically replicating data across multiple storage systems, the system creates virtual references to the same physical data blocks, eliminating redundant storage while maintaining data availability across multiple virtual instances.
Solution Approach 2:
The virtualized storage system serves multiple functions simultaneously: it provides data protection, enables multi-system access, reduces storage requirements, and manages backup operations. A single virtual storage pool serves multiple host systems, replacing the need for separate dedicated storage copies for each system.
2Quantity of substance
If de-duplication systems are used to reduce duplicate backups, then storage efficiency improves, but restore performance is slowed by the need to search through multiple copies
Solution Approach 1:
The system maintains a virtualized storage map that tracks which physical blocks correspond to which virtual copies. During restore operations, this metadata feedback mechanism enables the system to quickly identify the correct physical blocks without searching through multiple copies, achieving both storage efficiency and fast restore performance.
Solution Approach 2:
The virtualized storage layer acts as an intermediary between the physical storage and the host systems. It translates restore requests from multiple virtual copies into efficient physical block access, mediating between the need for storage efficiency and the need for fast restore operations.
3Reliability
If backups are performed automatically according to schedule, then data protection is maintained, but network traffic and processing load increase during backup windows
Solution Approach 1:
The system implements periodic backup cycles that operate during off-peak hours or scheduled windows. By consolidating backup operations into periodic cycles rather than continuous processes, the system maintains data protection while minimizing processing load during critical business periods.
Solution Approach 2:
Multiple backup operations from different host systems are merged into a single coordinated process. The virtualized storage system consolidates backup requests and processes them together, reducing the total processing load on individual systems while maintaining comprehensive data protection.
4Reliability
If data is restored from remotely located backup storage over low-bandwidth connections, then data availability is achieved, but restore time increases dramatically
Solution Approach 1:
The restore process is segmented into parallel operations where multiple data blocks are retrieved simultaneously from different physical locations. The virtualized storage map enables the system to divide large restore operations into manageable segments that can proceed in parallel, significantly reducing total restore time even over low-bandwidth connections.
Solution Approach 2:
The system transitions from sequential restore operations to parallel operations by adding a virtualization dimension. Instead of restoring data sequentially from a single remote location, the virtualized architecture enables simultaneous access to multiple physical blocks, effectively adding a temporal and spatial dimension to the restore process.
Data Source
AI summary
A method, article of manufacture, and apparatus for protecting data, comprising receiving information about objects stored on a plurality of hosts, determining whether an object needs to be backed up, and if the object needs to be backed up, requesting each host having the object to provide a portion of the object to a target. Information about the objects and backup may be stored in an index. A requesting host may request an object to be restored to a target. It is determined whether the object is available at the backup and at other hosts, and the backup and hosts having the object may be requested to provide portions of the object to the target, which may be the requesting host. The index may be used to determine availability of the object at the backup and other hosts.