Scalable Virtual Traffic Hubs for Network Packet Routing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing networking solutions in large provider networks struggle to efficiently manage network packet address manipulation and customized policy-based packet processing for virtualized computing services, leading to scalability issues as traffic from hundreds of thousands of virtual or physical machines is processed concurrently.

Innovation Solution

The implementation of scalable virtual traffic hubs (VTHs) using a multi-layer packet processing service, which employs multiple route tables to manage connectivity among isolated networks, allowing for flexible and asymmetric network traffic patterns, and enabling dynamic routing across regional resource collections.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If ad-hoc solutions for packet transformation are used to meet customized policy-based packet processing requirements, then flexibility in packet processing is improved, but scalability deteriorates as traffic from hundreds of thousands of virtual or physical machines is processed concurrently

Engineering Contradiction:
Improvepacket processing flexibilityVSAvoidscalability
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent segments the network into multiple isolated networks (VPCs) with hierarchical routing. Route tables are divided into default and custom route tables, allowing differentiated packet processing. This segmentation enables scalable architecture where each segment can be independently managed while maintaining overall system flexibility through the hub-and-spoke topology.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces internet gateways and virtual private gateways as intermediary components between isolated networks and external networks. These intermediaries handle packet transformation and policy-based processing centrally, allowing customized packet processing for specific traffic flows while maintaining standard processing for bulk traffic, thus resolving the contradiction between flexibility and scalability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If multiple route tables are implemented to manage connectivity among isolated networks, then network management flexibility is improved, but system complexity increases

Engineering Contradiction:
Improvenetwork management flexibilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The routing system is segmented into default route tables (managed by the system) and custom route tables (managed by customers). This segmentation simplifies complexity by separating system-controlled routing from user-controlled routing, allowing flexible network management without overwhelming system complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The route table structure serves multiple functions: it provides default routing for all isolated networks, supports custom routing policies, enables hub-and-spoke topologies, and facilitates both intra-network and external communication. This multi-functionality reduces the need for separate complex systems for each routing scenario.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Productivity

If virtualization technologies are used to share physical hosts among multiple users, then hardware utilization is improved, but network packet processing complexity increases

Engineering Contradiction:
Improvehardware utilizationVSAvoidnetwork packet processing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

Each virtual machine is assigned to a specific isolated network with its own routing context. This segmentation allows high hardware utilization through virtualization while managing packet processing complexity by providing clear network boundaries and dedicated route tables for each virtual machine or group of virtual machines.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Customers can independently configure custom route tables and routing policies for their own virtual machines without requiring manual intervention from the provider. This self-service capability allows high hardware utilization through efficient virtualization while reducing network packet processing complexity by enabling automated, policy-based routing decisions at the customer level.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20250126046A1Global-scale connectivity using scalable virtual traffic hubs
Publication Date: 2025.04.17 AMAZON TECH INC
  • US20250126046A1 patent drawing
  • US20250126046A1 patent drawing
  • US20250126046A1 patent drawing

AI summary

Network pathways are identified to transfer packets between a pair of regional virtual traffic hubs of a provider network. At a first hub of the pair, a first action is performed, resulting in a transmission of a packet received from a first isolated network to the second hub along a pathway selected using dynamic routing parameters. At the second hub, a second action is performed, resulting in the transmission of the packet to a destination within a second isolated network.