Deep Caching Infrastructure for Content Delivery Networks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current Content Delivery Networks (CDNs) face inefficiencies in delivering resources to end-users, as they often require clients to communicate directly with distant storage devices across access networks, leading to delays and reduced performance.

Innovation Solution

Implementing a deep caching infrastructure with local caching devices situated between access networks and client devices, which cache resources from multiple CDN devices, allowing for proactive loading and redirection of requests based on popularity and network conditions, thereby reducing the need for direct communication with distant servers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If clients communicate directly with distant storage devices across access networks, then resource delivery is achieved, but delivery speed and latency are reduced

Engineering Contradiction:
Improvecontent delivery speedVSAvoidlatency
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The patent segments the CDN infrastructure into multiple hierarchical caching layers: edge caches closest to clients, mid-tier caches, and origin servers. This segmentation places storage devices at different distances from clients, with local caches eliminating the need for direct communication with distant origin servers, thereby improving delivery speed and reducing latency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces local caching devices as intermediaries between clients and distant storage devices. These intermediaries cache frequently accessed content locally, so clients retrieve content from nearby caches rather than communicating directly with distant origin servers, thus improving speed and reducing latency.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Speed

If local caching devices are deployed closer to clients, then content delivery speed improves, but network infrastructure complexity increases

Engineering Contradiction:
Improvecontent delivery speedVSAvoidcaching infrastructure complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent merges multiple caching functions into a unified hierarchical CDN architecture. Local caches, mid-tier caches, and origin servers work together as an integrated system, sharing content and coordinating through standardized protocols. This merging reduces the operational complexity that would arise from managing separate, isolated caching systems.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent designs caching devices with multi-functionality: they can serve as edge caches for local content delivery, act as mid-tier caches for regional distribution, and function as origin servers for content storage and management. This universality reduces infrastructure complexity by using standardized devices for multiple purposes rather than requiring specialized equipment for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Reliability

If resources are cached locally, then delivery reliability improves, but storage capacity requirements increase

Engineering Contradiction:
Improvedelivery reliabilityVSAvoidstorage capacity
Core Design Contradiction:
ReliabilityVSVolume of stationary object

Solution Approach 1:

The patent applies local quality by caching different types of content at different hierarchical levels based on access patterns and content characteristics. Frequently accessed, small-to-medium files are cached locally at edge devices, while less frequently accessed or larger content remains at mid-tier and origin servers. This selective local caching improves delivery reliability for critical content without requiring all storage capacity to be located locally.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements partial caching rather than complete local storage. Only frequently accessed content is cached at local edges, while the full content library remains distributed across mid-tier and origin servers. This partial action approach improves reliability for popular content without requiring excessive local storage capacity.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10893118B2Content delivery network with deep caching infrastructure
Publication Date: 2021.01.12 SANDPIPER CDN LLC
  • US10893118B2 patent drawing
  • US10893118B2 patent drawing
  • US10893118B2 patent drawing

AI summary

Embodiments herein include methods and systems for use in delivering resources to a client device over a local network. An exemplary system comprises a plurality of caching devices operable to cache resources on behalf of a plurality of content providers, and a local caching device communicatively situated between an access network and the client device, wherein the access network is communicably situated between the plurality of caching devices and the local caching device. The local caching device is operable to retrieve a requested resource from at least one of the plurality of caching devices, deliver the requested resource to the client device over the local network, and store the requested resource for future requests by other client devices.