Bypass Flow Network Traffic Reduces Latency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Virtualization technologies incur performance costs due to networking devices that add latency and can become overburdened, especially when managing high volumes of network traffic, which reduces network efficiency.

Innovation Solution

Enabling bypass flows for network traffic between devices allows traffic to bypass networking devices once their initial benefits have been obtained, reducing the number of network hops and burden on these devices while retaining the benefits of load balancing and other networking features.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If network traffic is routed through networking devices for management and control, then network security and load balancing are improved, but network latency increases and device performance degrades

Engineering Contradiction:
Improvenetwork securityVSAvoidnetwork latency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The network traffic flow is segmented into two phases: initial flow establishment phase (where traffic passes through networking devices for security checks and load balancing) and data transfer phase (where traffic bypasses networking devices via direct peer-to-peer connection). This segmentation allows the system to obtain the benefits of network management initially while avoiding their performance costs during bulk data transfer.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The networking devices perform necessary security checks, authentication, and routing decisions in advance during the flow establishment phase. Once these preliminary actions are completed, the direct connection parameters are cached and used for subsequent data transfer without requiring further intervention from networking devices, thus eliminating ongoing latency.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If network traffic passes through multiple networking devices for management, then network control and security are maintained, but the number of network hops increases reducing efficiency

Engineering Contradiction:
Improvenetwork controlVSAvoidnetwork efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The network path is segmented into control plane traffic (which passes through networking devices for management and security) and data plane traffic (which flows directly between endpoints). This allows network control functions to be maintained while eliminating unnecessary hops for actual data transfer, thereby improving network efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The data transfer path is extracted from the control path. Instead of all traffic passing through networking devices, the system establishes a separate direct connection for data transfer while maintaining control plane connectivity through the networking devices. This extraction eliminates redundant hops and improves productivity.

Inventive Principle:
Principle #2Taking out (Extraction)

3Reliability

If networking devices handle all network traffic, then comprehensive network management is achieved, but device overburdening occurs reducing overall performance

Engineering Contradiction:
Improvenetwork managementVSAvoiddevice performance
Core Design Contradiction:
ReliabilityVSPower

Solution Approach 1:

Network traffic is segmented into control traffic (handled by networking devices) and data traffic (handled directly by endpoints). This segmentation offloads the bulk data transfer burden from networking devices, preventing overburdening while maintaining comprehensive network management capabilities for control functions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Endpoints are empowered to establish direct connections and handle their own data transfer without continuous intervention from networking devices. The endpoints use cached routing information and connection parameters to perform self-service data transfer, reducing the processing burden on networking devices while maintaining network management oversight.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10868758B1Enabling bypass flows for network traffic between devices
Publication Date: 2020.12.15 AMAZON TECH INC
  • US10868758B1 patent drawing
  • US10868758B1 patent drawing
  • US10868758B1 patent drawing

AI summary

Bypass flow may be enabled for network traffic between devices. A source device may include a flow identifier in an outbound packet that is sent to a destination device. An inbound packed sent from the destination device may include information that describes a network path between the source device and the destination device. Subsequent outbound packets bound for the destination device may be rewritten based on the information describing the network path to bypass one or more network devices in the network path.