Distributed Traffic Forwarding Units for Zone Failure Handling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing network systems face challenges in handling traffic forwarding failures across zones, leading to potential congestion, high latency, and packet losses due to the reliance on thin, capacity-constrained communication channels and the inability to quickly reroute traffic when a Traffic Forwarding (TF) system fails.

Innovation Solution

Implementing a distributed TF system with multiple units and servers that monitor health and automatically re-allocate bandwidth using ECMP routing, allowing healthy units to take over and prevent overloading of thin pipes, and providing quick notification of unavailable routes to prevent timeouts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single TF system is used for traffic forwarding in a zone, then the system structure is simple, but the system reliability deteriorates when the TF system fails

Engineering Contradiction:
ImproveTF system structureVSAvoidtraffic forwarding availability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent divides the TF system into multiple independent TF units (TFU0, TFU1, TFU2, etc.), each capable of handling traffic forwarding independently. This segmentation allows the system to maintain functionality even when individual units fail, resolving the contradiction between simple structure and high reliability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically changes the operational status parameter of TF units based on health checks. When a TF unit fails, its status changes from active to inactive, and traffic routing parameters are adjusted accordingly to bypass failed units, maintaining system reliability without requiring complex reconfiguration.

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If thin communication channels are used for inter-zone communication, then the network structure is simple, but the network capacity deteriorates causing congestion and latency

Engineering Contradiction:
Improvenetwork structureVSAvoidtraffic throughput
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent implements dynamic traffic routing that adapts to current network conditions. ECMP routing dynamically distributes traffic across multiple paths based on real-time health status of TF units and communication channels, allowing the system to optimize throughput without changing the underlying simple network structure.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system performs preliminary health checks and route validation before traffic fails over to alternative paths. This preliminary action ensures that backup routes are verified and ready, allowing quick switchover without causing congestion or latency during the transition.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If automatic health monitoring and failover mechanisms are implemented, then the system reliability improves, but the system complexity increases

Engineering Contradiction:
Improvetraffic forwarding availabilityVSAvoidmonitoring and control system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements a feedback mechanism where TF units continuously report their health status to the routing system. This feedback loop enables automatic detection of failures and triggers appropriate failover actions. The feedback-based approach improves reliability while keeping the control mechanism relatively simple compared to centralized monitoring systems.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

Each TF unit autonomously monitors its own health status and can independently signal its failure condition. This self-service approach eliminates the need for complex external monitoring systems, as each component is responsible for reporting its own status, simplifying the overall control architecture while maintaining high reliability.

Inventive Principle:
Principle #25Self-service

4Productivity

If ECMP routing is used for traffic distribution, then the traffic load balancing improves, but the routing complexity increases

Engineering Contradiction:
Improvetraffic distribution efficiencyVSAvoidrouting configuration
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies ECMP routing selectively to specific traffic flows and zones rather than universally across the entire network. This partial application provides load balancing benefits where needed while avoiding the full complexity of ECMP configuration throughout the entire routing infrastructure.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10237157B1Managing host failures in a traffic forwarding system
Publication Date: 2019.03.19 AMAZON TECH INC
  • US10237157B1 patent drawing
  • US10237157B1 patent drawing
  • US10237157B1 patent drawing

AI summary

Methods and apparatus for handling failure of servers in traffic forwarding (TF) systems between networks. A TF system may include units each including multiple servers. Outbound and inbound traffic for a local network may be distributed among the units according to a routing technique, with each unit responsible for an allocated portion of the traffic. Servers in a unit may participate in a health check protocol to detect servers that are not healthy. If the healthy servers in a unit drops below a threshold at which the unit cannot reliably handle its allocated portion of the traffic, the servers may automatically take the unit out of service, for example by stopping advertisement of routes, and the traffic may be reallocated across the remaining units. This may help prevent congestion-related delays, high latency, packet losses, and other problems on connections through the unhealthy unit.