Transitional Cache Node Array for CDN Load Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Content delivery networks (CDNs) face challenges in efficiently managing high-demand content and protecting against threats due to the overload of origin servers and the inefficiencies in caching large digital media files, as well as the need for threat detection and mitigation within the network.

Innovation Solution

Implementing a transitional cache node array that pre-caches and modifies content, acting as an intermediary between edge cache nodes and origin servers, which offloads processing tasks, transcodes media, and functions as a shield against threats, thereby reducing the load on edge cache nodes and enhancing operational performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If content is cached in edge cache nodes, then end user access speed is improved, but origin servers become overloaded and slow

Engineering Contradiction:
Improveend user access speedVSAvoidorigin server performance
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

A transitional cache node is introduced as an intermediary component between edge cache nodes and origin servers. This transitional cache node receives content requests from edge cache nodes, retrieves content from origin servers, and returns it to the edge cache nodes. By inserting this intermediate layer, the system reduces direct traffic load on origin servers while maintaining fast content delivery to end users through the edge cache network.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If transitional cache node array is implemented, then load on edge cache nodes is reduced, but device complexity increases

Engineering Contradiction:
Improveedge cache node efficiencyVSAvoidCDN architecture complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The caching system is segmented into distinct functional layers: edge cache nodes that handle end user requests, transitional cache nodes that manage content retrieval and modification, and origin servers that host source content. Each segment has specialized responsibilities, allowing edge cache nodes to focus on rapid content delivery while transitional cache nodes handle content management tasks, thereby improving overall productivity despite increased architectural complexity.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11159637B2Content delivery network transitional caching
Publication Date: 2021.10.26 FASTLY INC
  • US11159637B2 patent drawing
  • US11159637B2 patent drawing
  • US11159637B2 patent drawing

AI summary

Systems, methods, apparatus, and software for transitional caching in content delivery networks includes edge cache nodes configured to receive and reply to content requests. Content can be cached in edge cache nodes before receiving user requests or retrieved from an origin server. A transitional cache node array is configured to receive content requests from edge cache nodes and to receive origin content from edge cache nodes and/or origin servers, as well as to modify origin content to generate modified content. Modified content can include re-written origin content (e.g., translations), transcoded data (e.g., video), compressed or otherwise adjusted data (e.g., images), and transformed files (e.g., CSS and JavaScript files), among others. In addition to assisting with original and modified content flow to end users, transitional caching also can assist in threat detection and mitigation within a CDN, helping to protect the network, origin servers and the like.