Data Stream Segmentation for Multi-Path Routing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional backup techniques route mission critical data through a single network interface, leading to congestion and bottlenecks, and are unreliable due to limited error recovery mechanisms and inability to efficiently utilize multiple data paths, resulting in data loss and inefficient backup processes.
Innovation Solution
A method and apparatus that segregate data streams into blocks at the application layer, allowing routing through multiple data movers and paths independent of network interface type, with coordinated data path selection and error handling to ensure reliable and efficient data transfer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If data is routed through a single network interface, then the system is simple to manage, but the data path becomes congested and creates bottlenecks
Solution Approach 1:
The patent segments the data stream into multiple data blocks and routes them through different network interfaces simultaneously. Each data block can be transmitted independently over different paths, eliminating the bottleneck of a single interface while maintaining manageable system complexity through structured segmentation.
Solution Approach 2:
The patent transitions from single-dimension data transfer (one network interface) to multi-dimensional data transfer by utilizing multiple network interfaces concurrently. This adds spatial dimensionality to data routing, allowing parallel transmission paths and significantly increasing throughput without proportionally increasing management complexity.
2Device complexity
If conventional error recovery mechanisms are used, then the system is easy to implement, but the recovery granularity is coarse and inefficient
Solution Approach 1:
The patent segments the data stream into individually addressable data blocks, enabling fine-grained error recovery. When an error occurs, only the affected data block needs to be retransmitted rather than restarting the entire backup process, significantly improving recovery efficiency while maintaining straightforward implementation through block-level tracking.
Solution Approach 2:
The patent changes the granularity parameter of error recovery from coarse-grain (entire data stream) to fine-grain (individual data blocks). This parameter change enables more efficient recovery by allowing selective retransmission of only failed blocks, improving reliability without adding significant implementation complexity.
3Device complexity
If data is transmitted as a complete archiving file, then the file structure is simple, but fine granularity error recovery is not enabled
Solution Approach 1:
The patent segments the complete archiving file into smaller data blocks that can be independently routed and recovered. This segmentation enables fine-grained error recovery where only failed blocks need retransmission, while the overall file structure remains simple through standardized block formatting and indexing.
Solution Approach 2:
The patent introduces data blocks as intermediary units between the complete archiving file and the transmission process. These blocks serve as manageable intermediaries that enable fine-grained control and error recovery without complicating the overall file structure, as blocks can be reassembled into the original file format.
Data Source
AI summary
A method and apparatus for routing a data stream through a plurality of data movers independent of a network interface type is provided. In one embodiment, the method for routing the data stream to a destination with indifference to network interface type includes segregating the data stream into a plurality of data blocks at an application layer, wherein the plurality of data blocks are to be routed to a destination through the plurality of data movers and coordinating data path selection for communicating the plurality of data blocks to the plurality of data movers over a plurality of data paths.