CDN Latency Measurement via Client-Side Resource Requests

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Content providers face strain on computing resources due to high-volume content requests from client devices, and CDN service providers struggle to manage latency in delivering resources efficiently to meet service level agreements.

Innovation Solution

A content delivery network (CDN) service provider measures latency by generating resource requests from client computing devices, using executable code and resource identifiers to process and log performance metrics, allowing for efficient delivery and resource management.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a CDN service provider uses multiple computing devices to deliver content, then content delivery efficiency is improved, but latency management becomes more difficult

Engineering Contradiction:
Improvecontent delivery efficiencyVSAvoidlatency management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the CDN into multiple computing devices distributed across different locations. Each device can independently deliver content to clients, allowing the system to manage latency by routing requests to the nearest or most appropriate node. This segmentation enables parallel content delivery and reduces the complexity of managing a single large-scale delivery system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic routing decisions where the CDN service provider can real-time determine which computing device should fulfill a content request based on current network conditions, client location, and server status. This dynamic approach allows the system to optimize latency for each request while managing the complexity of multiple devices through intelligent control algorithms.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If the CDN service provider processes resource requests from multiple client devices, then service coverage is improved, but strain on computing resources increases

Engineering Contradiction:
Improveservice coverageVSAvoidcomputing resources
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent divides the computing resource load across multiple CDN nodes distributed geographically. Each node handles requests from clients in its service region, segmenting the total computing workload. This segmentation allows the CDN to serve more clients (improved coverage) without proportionally increasing the resource strain on any single node or the overall system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs content caching and replication where popular content is stored on multiple CDN nodes. When a client requests content, the nearest node with a cached copy can serve the request immediately without accessing the original source, reducing the computational burden on centralized resources while maintaining broad service coverage.

Inventive Principle:
Principle #26Copying

3Measurement precision

If the CDN service provider measures latency using resource requests, then delivery performance is improved, but measurement overhead increases

Engineering Contradiction:
Improvelatency measurement accuracyVSAvoidmeasurement overhead
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent implements a system where CDN nodes automatically measure and report their own latency performance without requiring external testing tools or manual intervention. The nodes use built-in timing mechanisms to measure request-response times and upload this data to the service provider, enabling accurate latency measurement while minimizing the time and resources required for measurement operations.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent establishes a feedback mechanism where CDN nodes continuously monitor and report latency metrics back to the service provider. This feedback loop enables the system to measure delivery performance accurately by collecting real-time data from multiple nodes, while the automated nature of the feedback process minimizes measurement overhead compared to manual testing approaches.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20180191817A1Latency measurement in resource requests
Publication Date: 2018.07.05 AMAZON TECH INC
  • US20180191817A1 patent drawing
  • US20180191817A1 patent drawing
  • US20180191817A1 patent drawing

AI summary

Systems and method for the management and processing of resource requests by a service provider, such as a content delivery network (“CDN”) service provider, on behalf of a content provider are provided. The CDN service provider can measure the performance associated with the delivery of resources to a requesting client computing devices from various computing devices associated with the CDN service provider. In one embodiment, a client computing device can execute code, such as scripts, that cause the client computing device to transmit requests to different computing devices associated with the CDN service provider's domain. Information associated with the processing of the responses can be used to measure CDN service provider latencies.