CDN Invalidation Sequencing via Layered Virtual Machine

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Content delivery networks (CDNs) face challenges in efficiently managing resource invalidation across distributed systems, leading to inconsistencies and increased latency in content delivery.

Innovation Solution

Implementing a system that utilizes a layered virtual machine (LVM) and request collection lattice (RCL) to manage resource invalidation through a distributed request processing system, enabling efficient computation and peering policy refinements across clusters and super-clusters.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If traditional resource invalidation methods are used in CDNs, then resource updates can be propagated, but latency increases and delivery efficiency decreases

Engineering Contradiction:
Improveinvalidation latencyVSAvoidcontent delivery efficiency
Core Design Contradiction:
Loss of timeVSProductivity

Solution Approach 1:

The system performs preliminary actions by pre-computing invalidation sequences and maintaining peering policies before invalidation is needed. The layered virtual machine architecture pre-establishes the hierarchical structure and relationships between clusters, enabling faster response when invalidation events occur without requiring real-time computation

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The CDN is segmented into a hierarchical structure with super-clusters containing multiple clusters, which are further divided into leaf clusters. This segmentation allows invalidation to be propagated in a structured manner through the hierarchy rather than requiring global synchronization across the entire distributed system, reducing overall latency

Inventive Principle:
Principle #1Segmentation

2Quantity of substance

If distributed request processing is implemented across multiple clusters, then system capacity increases, but coordination complexity and inconsistency risks increase

Engineering Contradiction:
Improvesystem capacityVSAvoidcoordination complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The layered virtual machine acts as an intermediary layer between the origin server and the distributed cluster network. It receives invalidation requests, computes the appropriate propagation sequence, and coordinates delivery to specific clusters in the hierarchical structure, simplifying the coordination complexity while maintaining high system capacity

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system introduces a hierarchical dimension to the distributed architecture, organizing clusters into super-clusters and leaf clusters. This dimensional organization allows for more efficient coordination by enabling invalidation to be targeted at specific hierarchical levels rather than requiring coordination across all nodes simultaneously

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Reliability

If real-time computation is performed for invalidation sequencing, then delivery freshness improves, but processing overhead increases

Engineering Contradiction:
Improvecontent freshnessVSAvoidprocessing overhead
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary computation by pre-establishing the hierarchical cluster relationships and peering policies in the layered virtual machine. When invalidation occurs, the system leverages these pre-computed structures to determine propagation sequences without requiring intensive real-time computation, reducing processing overhead while maintaining content freshness

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9634918B2Invalidation sequencing in a content delivery framework
Publication Date: 2017.04.25 SANDPIPER CDN LLC
  • US9634918B2 patent drawing
  • US9634918B2 patent drawing
  • US9634918B2 patent drawing

AI summary

A computer-implemented method includes providing, at a first time and to a first group of CD services in a CDN, invalidation information relating to at least one resource; and providing the invalidation information, at a second time distinct from the first time and to a second group of CD services in the CDN, the second group of CD services being substantially distinct from the first group of CD services.