Server-Side Latency Prediction for Adaptive Streaming

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Content delivery networks face long retrieval times due to network congestion and data transmission latencies, as existing adaptive bitrate streaming relies on client-side heuristic algorithms that delay network condition adjustments.

Innovation Solution

Implementing a server-side content adjustment system using a machine learning model trained with historical latencies to predict retrieval times, allowing the content server to proactively adjust content quality and bitrate based on network conditions, independent of client-side algorithms.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If client-side adaptive bitrate streaming is used, then the system can adapt to network conditions, but retrieval time increases due to delayed network condition detection and reaction

Engineering Contradiction:
Improveadaptive bitrate streamingVSAvoidretrieval time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The server performs preliminary actions by predicting retrieval times before content delivery begins. The machine learning model analyzes historical data and network conditions to forecast retrieval time in advance, allowing the server to proactively adjust content quality and bitrate before the client even requests the content, thereby eliminating the delay inherent in client-side detection.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback through a machine learning model that continuously learns from historical retrieval time data. The model processes feedback signals from actual retrieval performance and uses this information to refine future predictions, creating a closed-loop system that progressively improves its accuracy in predicting and optimizing content delivery.

Inventive Principle:
Principle #23Feedback

2Loss of time

If server-side content adjustment is implemented, then retrieval time is reduced, but system complexity increases due to machine learning model training and deployment

Engineering Contradiction:
Improveretrieval timeVSAvoidsystem complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The machine learning model serves as an intermediary component between the server and content delivery. Rather than directly implementing complex adaptive algorithms on the client side, the system introduces a server-side predictive model that simplifies the overall architecture by centralizing the complexity in a dedicated component that processes historical data and generates optimized delivery parameters.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system changes key parameters such as content quality and bitrate based on predicted retrieval times. By dynamically adjusting these parameters before content delivery, the server optimizes the balance between retrieval time and quality without requiring complex real-time decision-making algorithms on the client side.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If high quality content is delivered, then user experience improves, but retrieval time increases due to larger data transmission size

Engineering Contradiction:
Improveuser experienceVSAvoidretrieval time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system dynamically adjusts content quality and bitrate based on predicted retrieval times and network conditions. Rather than delivering content at a fixed high quality, the server dynamically adapts the delivery parameters to optimize both retrieval time and quality, using machine learning predictions to determine the optimal balance point for each specific delivery scenario.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11962825B1Content adjustment system for reduced latency
Publication Date: 2024.04.16 AMAZON TECH INC
  • US11962825B1 patent drawing
  • US11962825B1 patent drawing
  • US11962825B1 patent drawing

AI summary

Techniques for reducing the latency of content retrieval from a content delivery network include receiving a request from a client device for media content, parsing the request for attributes associated with the request and the client device, and providing the attributes to a machine learning model to perform server-side prediction of an estimated retrieval time of the media content. A quality level for the media content is determined based on the estimated retrieval time, and the requested media content is provided to the client device at the determined quality level.