Parallel Data Connections for Backup Speed
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The time-consuming nature of big data backup and restoration operations, particularly in enterprise environments, where full backups can take several days and impact business operations, and restoration processes are similarly lengthy, necessitating a more efficient method to complete these tasks quickly.
Innovation Solution
Establishing multiple parallel data connections between a source device and a target device using Network Data Management Protocol (NDMP) to enhance data transfer speed and reliability, enabling data backup and restoration through a plurality of TCP connections with enabled receiving ports.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a single data connection is used for data transfer, then the system complexity is low, but the data transfer speed is slow and backup/restoration takes too much time
Solution Approach 1:
The patent divides the data transfer process into multiple parallel connections instead of using a single connection. The source device establishes multiple data connections with the target device, each connection handling a portion of the data transfer simultaneously. This segmentation of the transfer pathway increases overall throughput while maintaining manageable complexity through standardized connection protocols.
Solution Approach 2:
The patent transitions from a single-dimensional data transfer approach (one connection) to a multi-dimensional approach by establishing parallel connections across different port pairs. This adds the dimension of parallelism to the transfer architecture, enabling simultaneous data flows that collectively achieve higher throughput without proportionally increasing system complexity.
2Loss of time
If multiple parallel data connections are established, then the data transfer speed increases and backup time is reduced, but the system complexity and port management becomes more complex
Solution Approach 1:
The patent performs preliminary actions by pre-establishing multiple data connections between the source device and target device before the actual data transfer begins. The connection establishment phase includes negotiating and enabling multiple port pairs in advance, so that when data transfer starts, all connections are ready to operate simultaneously. This preliminary setup reduces the time penalty that would otherwise be incurred during the transfer phase.
3Ease of operation
If a single data connection is used, then the port management is simple, but the restoration speed is slow and business operations are disrupted for longer periods
Solution Approach 1:
The patent segments the data restoration process into multiple parallel connections, allowing different portions of the backup data to be restored simultaneously through different port pairs. This segmentation enables the restoration operation to complete faster, reducing the disruption to business operations, while each individual connection remains simple to manage using standard protocols.
Data Source
AI summary
Embodiments of the present disclosure provide a data transfer method and apparatus by establishing, at a source device, a plurality of data connections with a target device in response to a data connection establishment request from a client, the data connection establishment request carrying information on a plurality of receiving ports that have been enabled by the target device; and transferring data from the source device to the target device via the plurality of data connections, and data transfer/receiving method and apparatus according to the embodiments of the present disclosure leverage a plurality of parallel data connections from a source device to a target device to transfer data, thereby enhancing the speed and reliability of data backup or restoration.