CDN Point of Presence Failover via Redundant Route Advertising

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing content delivery networks (CDNs) face challenges in rapidly handling point of presence (POP) failures, leading to service interruptions and cascading failures due to overwhelming other POPs, which can result in significant downtime and impact user experience.

Innovation Solution

The implementation of redundant routes advertised by POP routers allows other network devices to quickly redirect traffic to alternative POPs in case of a failure, ensuring continuous service and minimizing the impact on customers by intelligently distributing traffic and enabling seamless failover and self-healing mechanisms.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traffic is rapidly redirected to alternative POPs upon failure, then service continuity is improved, but other POPs may become overwhelmed causing cascading failures

Engineering Contradiction:
Improveservice continuityVSAvoidcascading failures
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent implements dynamic traffic adjustment by continuously monitoring POP health status and automatically adjusting traffic distribution in real-time. When a POP fails, the system dynamically redirects traffic to healthy POPs while preventing overload through capacity monitoring and adaptive load balancing, thus maintaining service continuity without causing cascading failures.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system employs feedback mechanisms by monitoring the operational status of POPs and traffic load conditions. This feedback loop enables the system to detect failures, adjust traffic routing accordingly, and prevent overwhelming alternative POPs by considering their current capacity status, thereby resolving the contradiction between service continuity and preventing cascading failures.

Inventive Principle:
Principle #23Feedback

2Reliability

If DNS records are updated to redirect traffic away from failed POPs, then service availability is improved, but DNS propagation delays cause service interruptions

Engineering Contradiction:
Improveservice availabilityVSAvoidDNS propagation delay
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent implements preliminary action by pre-configuring alternative POP routes and maintaining ready-to-use failover paths. When a POP fails, traffic can be redirected immediately using pre-established routing information rather than waiting for DNS propagation, thus improving service availability while minimizing downtime.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses an intermediary routing layer (such as Anycast or BGP routing) that sits between the client and the final POP destination. This intermediary can rapidly redirect traffic to alternative POPs without requiring DNS updates, effectively bypassing DNS propagation delays while maintaining service availability.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Speed

If redundant routes are advertised by all POPs, then failover speed is improved, but network complexity increases

Engineering Contradiction:
Improvefailover speedVSAvoidnetwork complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the network into autonomous system segments, where each segment advertises routes independently using standardized protocols like BGP. This segmentation allows rapid failover within segments while keeping the overall network complexity manageable through modular, standardized interactions between segments.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system employs universal routing protocols (such as BGP and Anycast) that can be implemented across all POPs with standardized configurations. This multi-functionality enables all POPs to participate in redundant route advertising using the same protocol framework, achieving fast failover without proportionally increasing complexity through standardization.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11038745B1Rapid point of presence failure handling for content delivery networks
Publication Date: 2021.06.15 AMAZON TECH INC
  • US11038745B1 patent drawing
  • US11038745B1 patent drawing
  • US11038745B1 patent drawing

AI summary

Techniques for rapid point of presence failure handling for a content distribution network are described. A traffic management service collects network traffic utilization information from multiple POPs and, together with POP capacity information, identifies one or multiple other failover POPs that can accommodate the traffic of a particular POP in the event of its failure. The service can cause routers of these POPs to advertise redundant routes to neighboring edge devices such that the redundant routes are only used in the event of a detected failure of the primary POP.