Portable Storage Backup for Slow Network Throughput
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing network-based backup systems face inefficiencies due to slow network data throughput and large initial full backup data transfers, making initial full backups impractical, especially over slow networks.
Innovation Solution
A system that uses a portable storage device for direct coupling between the backup site and client to transfer full backup data, separate from the network, followed by incremental backups over the network, with encryption options and various connection types like USB, Firewire, or eSATA, allowing only a subset of data to be stored on the device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If full backup data is transferred over the network, then centralized backup management is achieved, but the backup time becomes unacceptably long due to slow network throughput
Solution Approach 1:
The backup process is segmented into two distinct phases: (1) initial full backup via portable storage device for rapid data transfer, and (2) subsequent incremental backups over the network. This segmentation allows the time-sensitive full backup to use fast local storage while leveraging the network only for smaller incremental updates, thereby resolving the contradiction between centralized management and backup time.
Solution Approach 2:
The portable storage device acts as an intermediary between the client and the backup site, enabling rapid full backup transfer without relying on the network infrastructure. This intermediary approach bypasses the network speed limitation while still achieving centralized backup management, as the portable device is subsequently processed through the centralized backup system.
2Productivity
If incremental backups are used, then network throughput requirements are reduced, but the initial full backup still requires excessive time over the network
Solution Approach 1:
The backup workflow is divided into two segments: the initial full backup segment uses portable storage devices for rapid data transfer, while the incremental backup segment utilizes the network. This segmentation eliminates the bottleneck of transferring large full backup data over the network, allowing the system to leverage fast local storage for the time-consuming full backup while maintaining network utilization efficiency for smaller incremental updates.
3Speed
If portable storage devices are used for full backup, then backup speed is improved, but device complexity and logistics increase
Solution Approach 1:
The portable storage device is designed to be self-contained and self-service capable. It automatically formats itself, performs the full backup without requiring administrator manipulation, and can be independently shipped and processed. This self-service design minimizes the operational complexity despite the addition of portable devices, as the system requires no specialized media I/O devices or complex manual intervention.
Data Source
AI summary
Backing up data from a client includes providing a direct coupling between the client and a portable storage device, copying full backup data from the client to the portable storage device using the direct coupling, and performing at least one incremental backup from the client to the backup site through a network that is separate from the direct coupling. The at least one incremental backup is based on the prior full backup. The network may be the Internet. Following copying full backup data to the portable storage device, the portable storage device may be shipped from the client to the backup site. The direct coupling may be USB, Firewire, or eSATA. Only a subset of data corresponding to a backup dataset may be copied from the client to the portable storage device.