Backup Data Transfer System for Bandwidth Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for transferring user data backups between logical data sites face challenges in minimizing network bandwidth usage and maintaining data locality, leading to inefficiencies in backup and restore processes.
Innovation Solution
A method and system that determine and transfer backup data based on storage and schedule parameters, allocate network bandwidth, and prioritize data transfers to optimize storage and reduce network costs, while preserving data locality by scheduling transfers strategically.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Volume of stationary object
If user data backup is transferred to another logical data site to relieve space pressure, then storage capacity is improved, but network bandwidth consumption increases
Solution Approach 1:
The system performs preliminary identification of transferable backup data by analyzing storage parameters and determining which data can be moved without affecting client backup or restore operations. This preliminary action allows the system to plan transfers in advance, selecting data that can be moved with minimal network bandwidth consumption and minimal interruption to data protection operations.
Solution Approach 2:
The system dynamically schedules data transfers based on varying network conditions, storage parameters, and operational requirements. Transfer scheduling is adjusted in real-time to optimize network bandwidth usage, transferring data during periods of lower network utilization and prioritizing transfers that maintain data locality where possible, thereby resolving the contradiction between storage capacity expansion and network bandwidth conservation.
2Productivity
If user data backup is transferred between logical data sites, then storage balance is improved, but interruption to backup and restore processes increases
Solution Approach 1:
The system identifies and flags backup data as transferable only after confirming that its transfer will not interrupt client backup or restore operations. This preliminary validation ensures that data selected for transfer is either already backed up, has redundant copies, or is not currently being accessed, thereby maintaining storage balance while preventing interruptions to data protection processes.
Solution Approach 2:
The system continuously monitors backup and restore operations, using feedback from these operations to dynamically adjust transfer scheduling. When backup or restore activities are detected on data slated for transfer, the system automatically delays or reschedules the transfer, ensuring storage balance is maintained without causing interruptions to critical data protection processes.
3Speed
If data transfer is performed to maintain data locality, then restore performance is improved, but network bandwidth usage increases
Solution Approach 1:
The system prioritizes maintaining data locality by transferring backup data within the same data center or to nearby logical data sites rather than to remote locations. This local quality approach ensures that data remains geographically proximate to clients, preserving fast restore performance while minimizing network bandwidth consumption associated with long-distance data transfers.
Solution Approach 2:
The system dynamically determines the optimal destination for transferred data based on client location, network conditions, and storage availability. By adaptively selecting destination sites that maintain data locality, the system achieves high restore performance while optimizing network bandwidth usage, transferring data only when and where it provides maximum benefit with minimum cost.
Data Source
AI summary
The present application is directed to systems and methods for transferring data between data backup sites. A backup data transfer of data associated with a client device is scheduled, and backup data is transferred from a source data backup site to a destination data backup site. A backend process associated with the client device is suspended, and a determination is made as to whether all backup data for the client has transferred from the source backup data site to the destination backup data site. Responsive to the determination, the backend process associated with the client device is resumed.