Content Delivery Network Latency and Cost Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Content delivery networks (CDNs) face challenges in efficiently managing client computing device content requests, particularly with large-scale implementations and high-resolution content, which strain computing resources and incur higher costs due to considerations of latency and delivery quality.

Innovation Solution

The solution involves selecting computing devices for content delivery based on logic that minimizes latency for a first subset of content and cost for a second subset, using Point of Presence locations, and prioritizing the transmission of content subparts such as frames to optimize delivery efficiency and cost-effectiveness.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a CDN service provider uses multiple computing devices to deliver content, then delivery quality and latency are improved, but cost increases

Engineering Contradiction:
Improvedelivery qualityVSAvoidcost
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The patent segments content into encoded subparts (frames) and distributes them across multiple computing devices at different POP locations. This allows the system to deliver content from multiple sources simultaneously, improving reliability and reducing latency while managing costs by selectively using multiple devices only when necessary.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically selects which computing devices to use for content delivery based on real-time conditions such as latency requirements, cost considerations, and content characteristics. This dynamic allocation allows the CDN to optimize the balance between delivery quality and cost for each content request.

Inventive Principle:
Principle #15Dynamics

2Reliability

If high-resolution content is transmitted to meet quality requirements, then delivery quality is improved, but transmission cost and computing resource strain increase

Engineering Contradiction:
Improvedelivery qualityVSAvoidtransmission cost
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The patent changes the parameter of content representation by encoding content into compressed subparts (frames) that can be selectively transmitted. This encoding allows the system to maintain high delivery quality by transmitting only necessary content portions at appropriate resolution levels, thereby reducing transmission costs and computing resource requirements.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

By segmenting high-resolution content into smaller encoded frames, the system can transmit content more efficiently. The segmentation allows for selective transmission of only the necessary frames to achieve the required quality level, reducing overall transmission cost and resource strain compared to transmitting complete high-resolution content.

Inventive Principle:
Principle #1Segmentation

3Loss of energy

If content is delivered from a single computing device, then cost is reduced, but latency increases

Engineering Contradiction:
ImprovecostVSAvoidlatency
Core Design Contradiction:
Loss of energyVSLoss of time

Solution Approach 1:

The patent introduces encoded content subparts as intermediaries that can be pre-positioned at multiple POP locations. This allows the system to reduce latency by delivering content from the nearest available POP while managing costs by using multiple intermediaries only when the latency benefit justifies the additional expense.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS9288153B2Processing encoded content
Publication Date: 2016.03.15 AMAZON TECH INC
  • US9288153B2 patent drawing
  • US9288153B2 patent drawing
  • US9288153B2 patent drawing

AI summary

A system and method for the management of client computing device content requests by service providers are provided. The requested content corresponds to content organized as a series of ordered frames, which include a number of reference frames. The management of the content requests can include the selection of computing devices corresponding to various Point of Presence locations for providing requested content. The selection of the computing devices can incorporate logic related to the delivery of a first subset of the content from a Point of Presence based on minimizing delivery latencies. The selection of the computing devices can incorporate logic related to the delivery of a second subset of the content from a second Point of Presence based on minimizing costs associated with delivery of the second subset.