Egress Traffic Manager for Cloud Network Routing Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Public cloud networks lack control over end-to-end routing, leading to performance issues due to reliance on Internet Service Providers for egress traffic routing, which can result in delays and suboptimal routing decisions.

Innovation Solution

An egress traffic manager system that includes a processor and memory for configuring edge routers with virtual routers to dynamically route egress traffic through selected external networks based on latency and network telemetry, using existing commodity routers and BGP sessions, allowing for adaptive routing without replacing existing infrastructure.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If traffic is routed through Internet Service Providers on a lowest cost basis, then routing cost is minimized, but routing performance and control over egress traffic are degraded

Engineering Contradiction:
Improverouting costVSAvoidrouting performance
Core Design Contradiction:
Loss of energyVSReliability

Solution Approach 1:

The patent segments egress traffic into different categories and routes them through different paths: optimized routes for performance-critical traffic and default routes for other traffic. This allows the system to balance cost and performance by applying different routing strategies to different traffic types.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically changes routing parameters based on network conditions, traffic type, and performance requirements. By adjusting routing decisions in real-time, the system can optimize both cost and performance rather than relying on static lowest-cost routing.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If dynamic routing based on network conditions is implemented, then routing efficiency and performance are improved, but system complexity increases

Engineering Contradiction:
Improverouting efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent introduces an egress traffic manager as an intermediary component that handles the complexity of dynamic routing decisions. This mediator monitors network conditions, evaluates routing options, and makes routing decisions, thereby isolating the complexity from the core routing infrastructure and making the system more manageable.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements feedback mechanisms that continuously monitor network conditions, latency, and traffic patterns. This feedback is used to dynamically adjust routing decisions, allowing the system to adapt to changing conditions while maintaining manageable complexity through automated control loops.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11979318B2Egress traffic engineering in public clouds with commodity routers on the WAN edge
Publication Date: 2024.05.07 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11979318B2 patent drawing
  • US11979318B2 patent drawing
  • US11979318B2 patent drawing

AI summary

The present application relates to egressing traffic from a public cloud network. An egress traffic manager configures routing at hosts and edge routers within the public cloud network. The egress traffic manager determines, for an edge router, a plurality of current border gateway protocol (BGP) sessions with external networks. The egress traffic manager configures a virtual router hosted on the edge router to route a portion of egress traffic to a selected one of the external networks via one of the BGP sessions. A host is configured to route the portion of egress traffic within the public cloud network to the edge router. An edge router configured to route, by the virtual router, the portion of egress traffic from the edge router to the selected one of the external networks.