WAN Optimization Layer for Big Data Transfer Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional data transfer protocols like TCP are inefficient in high bandwidth-delay product networks, leading to vulnerabilities in heavy data traffic environments, and current optimization methods require application changes, which are costly and impractical.
Innovation Solution
Implementing a WAN optimization layer using the BURST protocol over UDP, combined with the EWOC layer, which provides a standalone software module that substitutes standard network modules without requiring application changes, optimizing big data transfers by employing smart flow control and compression algorithms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If TCP protocol is used for data transmission, then reliability is maintained through error checking and delivery validation, but transmission efficiency deteriorates in high bandwidth-delay product networks due to drastic congestion window reduction
Solution Approach 1:
The patent segments the transmission protocol functionality into multiple layers: application layer, transmission layer (with alternative protocols like BURST), and network layer. This allows the reliable delivery validation to be maintained at the application layer while using more efficient protocols at the transmission layer, resolving the contradiction between reliability and efficiency.
Solution Approach 2:
The patent introduces an intermediary transmission layer protocol (BURST) that sits between the application layer and network layer. This intermediary handles efficient data transmission while the application layer maintains reliability through validation, thus resolving the contradiction by distributing functions across layers.
2Productivity
If alternative protocol BURST is used to improve transmission efficiency, then productivity increases in high BDP networks, but device complexity increases due to additional protocol layers
Solution Approach 1:
The patent designs the transmission layer to support multiple protocols (TCP, BURST, and others) that can be selected based on network conditions. This universal approach allows the system to achieve high productivity in high BDP networks using BURST while maintaining the option to use simpler protocols when appropriate, thus managing complexity effectively.
Solution Approach 2:
The patent implements dynamic protocol selection where the system can switch between different transmission protocols based on network conditions, data characteristics, and performance requirements. This dynamic approach allows optimal productivity in high BDP networks while managing complexity by using simpler protocols when they suffice.
3Productivity
If application changes are implemented to use optimized protocols, then transmission efficiency improves, but ease of operation deteriorates due to system administration overhead
Solution Approach 1:
The patent introduces an intermediary transmission layer that handles protocol optimization without requiring application changes. This intermediary layer (with libraries like libburst and libtcp) transparently manages efficient data transmission, maintaining ease of operation while improving productivity.
Solution Approach 2:
The patent implements self-service mechanisms where the transmission layer automatically selects and configures optimal protocols based on network conditions and data characteristics, without requiring manual system administration. This automation maintains ease of operation while achieving high transmission efficiency.
Data Source
AI summary
Embodiments are described for systems and methods that optimize large-scale data transfers over a wide area network by providing a data transmission protocol stack comprising a TCP layer that exchanges data processed by a host, and an IP layer that transports datagrams encapsulating the data to routers in the WAN, and a UDP-based transmission layer within the data transmission protocol stack that interfaces with the TCP layer and transmits data and control packets between the host and receivers of the WAN using a unicast duplex protocol. The stack has a WAN optimization components layer that interacts with the UDP-based transmission layer and provides transport protocol optimization through the UDP-based transmission layer and certain data de-duplication, compression, link aggregation, and application awareness functions.