Dynamic CMAF Chunk Processing for Low Latency Streaming

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current content delivery systems face challenges in reducing latency and efficiently managing encoded video content segments, particularly in live streaming, due to fixed bitrate approaches and inefficiencies in processing buffered media chunks, which can lead to rebuffering and increased latency.

Innovation Solution

A video segment processing system that dynamically forms content segments from encoded chunk data, applies heuristic rules based on effective framerate and chunk framerate comparisons, and discards unnecessary chunks to optimize bitrate selection and reduce latency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If fixed bitrate approaches are used for content delivery, then content transmission stability is improved, but latency is increased and user experience deteriorates

Engineering Contradiction:
Improvecontent transmission stabilityVSAvoidlatency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system dynamically adjusts bitrate based on real-time network conditions and playback state by comparing effective framerate with chunk framerate thresholds, transitioning between different bitrate modes (aggressive, conservative, nominal) to optimize both latency and transmission stability

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the bitrate parameter dynamically based on playback state (buffered, playing, rebuffering) and framerate comparisons, allowing the content delivery to adapt between fixed and variable bitrate approaches to resolve the contradiction between stability and latency

Inventive Principle:
Principle #35Parameter changes

2Reliability

If all encoded video content chunks are retained in buffer, then content availability is improved, but processing efficiency deteriorates and rebuffering occurs

Engineering Contradiction:
Improvecontent availabilityVSAvoidprocessing efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system selectively discards encoded video chunks from the buffer based on framerate comparisons and playback state, removing unnecessary content to improve processing efficiency while maintaining sufficient content availability for continuous playback through intelligent retention of essential chunks

Inventive Principle:
Principle #34Discarding and recovering

Solution Approach 2:

Instead of retaining all possible chunks, the system retains only the necessary portion required for continuous playback by comparing effective framerate with chunk framerate, achieving sufficient content availability with reduced processing overhead

Inventive Principle:
Principle #16Partial or excessive action

3Manufacturing precision

If comprehensive chunk processing is performed, then content quality is improved, but processing time increases and latency is increased

Engineering Contradiction:
Improvecontent qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs partial processing of chunks by comparing effective framerate with chunk framerate thresholds and selectively processing only necessary portions, achieving adequate content quality without the time cost of comprehensive processing of all chunks

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system adjusts processing intensity based on playback state and framerate comparisons, changing processing parameters dynamically to balance content quality requirements against processing time constraints in different operational contexts

Inventive Principle:
Principle #35Parameter changes

4Reliability

If buffer size is increased to prevent rebuffering, then playback continuity is improved, but latency is increased

Engineering Contradiction:
Improveplayback continuityVSAvoidlatency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system dynamically adjusts buffer management strategy based on real-time playback state and framerate comparisons, transitioning between aggressive bitrate mode (faster processing, smaller effective buffer) and conservative mode (slower processing, larger effective buffer) to balance playback continuity against latency

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes buffer utilization parameters dynamically based on playback state (buffered, playing, rebuffering) and effective framerate measurements, optimizing the trade-off between buffer size for continuity and processing speed for latency reduction

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11743518B2Player methods for chunked CMAF low latency playback
Publication Date: 2023.08.29 AMAZON TECH INC
  • US11743518B2 patent drawing
  • US11743518B2 patent drawing
  • US11743518B2 patent drawing

AI summary

A content streaming system and methodology for facilitating the management of content streaming. A video packaging and origination service provides streaming content that is organized according to a set of encoded content chunks. A video playback application processes the set of encoded content chunks to dynamically form a content segment for live video streaming. The video playback application further processes the set of encoded content chunks to apply framerate heuristics associated with encoded content segments.