Adaptive Media Buffer Management for Real-Time Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional buffering schemes are ineffective in mitigating issues with live and real-time media streams, as they introduce delays that harm the presentation experience, and cannot handle packet loss efficiently in real-time communications.
Innovation Solution
An adaptive media buffer management system that discards media segments based on round trip delay, current buffer depth, and segment layers, and determines whether to request retransmission of lost packets, allowing for continuous presentation of media streams without freezing or artifacts.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional buffering is used to store media segments, then packet loss is mitigated and media continuity is maintained, but delay increases and real-time presentation quality deteriorates
Solution Approach 1:
The buffer management system dynamically adjusts buffer depth and segment retention based on real-time network conditions, packet loss rates, and playback state. Instead of using a fixed buffer size, the system adapts its buffering behavior to balance between maintaining media continuity and minimizing delay for real-time presentation.
Solution Approach 2:
The system changes key parameters such as buffer depth, segment retention time, and retransmission timing based on detected network conditions and playback state. By dynamically modifying these parameters, the system optimizes the trade-off between reliability (media continuity) and time loss (buffer delay) for different operational scenarios.
2Reliability
If buffer depth is increased to handle packet loss, then media continuity is improved, but presentation delay increases and real-time experience deteriorates
Solution Approach 1:
The system dynamically controls buffer depth based on real-time conditions including packet loss rates, network latency, and playback state. When packet loss is detected, the system selectively retains specific segments while allowing others to be discarded, maintaining media continuity without unnecessarily increasing overall buffer depth and associated delays.
Solution Approach 2:
Instead of uniformly increasing buffer depth across all segments, the system applies selective retention to specific segments based on their importance, type (e.g., key frames vs. delta frames), and position in the playback sequence. This localized approach maintains continuity where critical while minimizing delay elsewhere.
3Reliability
If retransmission is requested for lost packets, then packet loss recovery is improved, but buffer delay increases and real-time presentation is hindered
Solution Approach 1:
The system performs preliminary assessment of buffer state and network conditions before initiating retransmission requests. By evaluating whether sufficient buffer depth exists and whether retransmission would cause unacceptable delays, the system decides in advance whether retransmission is worthwhile, avoiding unnecessary retransmission delays.
Solution Approach 2:
Instead of requesting retransmission for all lost packets, the system selectively requests retransmission only for critical segments that cannot be recovered from existing buffer content. For less critical segments, the system accepts the loss rather than incurring retransmission delay, applying partial action only where necessary.
4Loss of time
If media segments are discarded to reduce delay, then real-time presentation is improved, but media quality deteriorates due to artifacts and freezing
Solution Approach 1:
The system applies different retention policies to different segments based on their local characteristics such as segment type (key frame, delta frame, reference frame), position in playback sequence, and importance to media continuity. Critical segments are retained while less critical segments may be discarded, maintaining quality where necessary while reducing delay elsewhere.
Solution Approach 2:
The system dynamically changes segment retention parameters based on detected conditions including packet loss patterns, network latency, and current buffer state. By adapting retention policies to current conditions, the system minimizes quality deterioration while achieving acceptable delay reduction for real-time presentation.
Data Source
AI summary
Embodiments disclosed herein provide systems, methods, and computer readable media that perform adaptive management of a media buffer. In a particular embodiment, a method provides receiving packets representing a media stream into the adaptive media buffer, wherein the media stream comprises a sequence of media segments structured into segment layers, and detecting loss of one or more of the packets representing one of the media segments. The method further provides estimating a round trip delay for packets between the adaptive media buffer and a sender of the media stream and determining a current depth of the media segments within the adaptive media buffer. In response to detecting the packet loss, the method provides discarding media segments within the adaptive media buffer based on the round trip delay, the current depth, and a layer of the segment layers into which each of the one or more media segments is included.