Proactive Rate Adaptation Signaling for Streaming Buffer Stability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In multimedia streaming, existing technologies face challenges in maintaining a smooth playback experience due to dynamically changing throughput characteristics, leading to buffer underflow or overflow, especially during handovers, retransmissions, and clock drift, where the sender and receiver may take conflicting actions, resulting in severe user experience degradation.

Innovation Solution

The solution divides responsibilities between the server and client for rate adaptation, where the server adapts transmission and sampling rates within a negotiated operating range, and the client compensates for packet transfer delay variations, using parameters like minimum and target shift amounts, maximum send-ahead bytes, and clock shift to prevent buffer disruptions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the server increases transmission rate to match varying throughput, then playback smoothness is improved, but buffer overflow risk increases

Engineering Contradiction:
Improveplayback smoothnessVSAvoidbuffer fullness
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The server proactively signals the client about upcoming rate changes before they occur. This allows the client to adjust its buffer management and playout rate in advance, preventing both buffer overflow and underflow by preparing the system for rate transitions ahead of time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses feedback loops where the server monitors throughput characteristics and buffer status, then adjusts transmission rate and signals the client accordingly. The client provides feedback about buffer fullness and playout status, enabling coordinated rate adaptation that maintains playback smoothness while preventing buffer overflow.

Inventive Principle:
Principle #23Feedback

2Reliability

If the client increases receiver buffer size to prevent underflow, then playback continuity is improved, but packet delay increases

Engineering Contradiction:
Improveplayback continuityVSAvoidpacket delay
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The server provides preliminary signaling about rate changes, allowing the client to adjust buffer consumption rate proactively rather than reactively. This reduces the need for large buffer sizes because the client can anticipate rate changes and adjust playout timing in advance, maintaining continuity with smaller delays.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts the effective buffer utilization based on predicted rate changes. Instead of using a fixed large buffer, the client dynamically modifies its buffer consumption rate in response to server signals, optimizing the trade-off between continuity and delay by adapting buffer usage to upcoming rate conditions.

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If the server and client independently adapt rates, then system flexibility is improved, but coordination conflicts increase leading to buffer disruptions

Engineering Contradiction:
Improverate adaptation flexibilityVSAvoidbuffer stability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The server acts as an intermediary that coordinates rate adaptation between itself and the client. By providing proactive signals about rate changes and maintaining awareness of buffer status, the server mediates the interaction between sender and receiver adaptations, ensuring they work together rather than conflict, thus maintaining buffer stability while preserving flexibility.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system establishes feedback channels where the server informs the client about rate changes and the client informs the server about buffer status. This coordinated feedback mechanism ensures that both parties adapt their rates in a synchronized manner, preventing conflicts that would lead to buffer underflow or overflow while maintaining the flexibility to respond to varying network conditions.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS7844727B2Method and device for proactive rate adaptation signaling
Publication Date: 2010.11.30 NOKIA TECHNOLOGIES OY
  • US7844727B2 patent drawing
  • US7844727B2 patent drawing
  • US7844727B2 patent drawing

AI summary

A method and system for adaptively controlling level of a receiver buffer in a client in a multimedia streaming network. The multimedia streaming network has a server for providing streaming data to the client. The server is responsible for adapting the transmission rate to the reception rate or congestion control, and for adapting the sampling rate to the transmission rate. Thus, the server manages the shift and keeps it within the rate adaptation operating range. The client is responsible for compensating for the packet transfer delay variation, which is also known as network jitter. The client is also responsible for setting parameters of the server rate adaptation operating range. The client chooses and sends the shift parameters to the server, but it is up to the server to adapt its encoding rate or transmission rate when responding to the parameters.