Multimedia Streaming Representation Switching for Buffer Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing network streaming technologies face challenges in providing an optimal user experience during initial content retrieval and bandwidth adaptation, as they often require lengthy buffering times and may result in interruptions due to varying network conditions.

Innovation Solution

The proposed solution involves determining the intervals between switch points for different representations of multimedia content and strategically selecting a representation with more frequent switch points for initial buffering, then switching to a higher-quality representation with less frequent switch points once sufficient data is buffered, allowing for seamless playback and adaptation to changing bandwidth conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If a representation with less frequent switch points (higher quality) is selected for streaming, then perceived quality is improved, but buffering time increases and playback may be interrupted under varying network conditions

Engineering Contradiction:
Improveperceived qualityVSAvoidbuffering time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary buffering of lower-quality representation data before switching to higher-quality representation. This advance preparation ensures that sufficient data is available in the buffer to support seamless transitions to higher quality streams without interruption, resolving the contradiction between quality and buffering time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically switches between different representations based on buffer status and network conditions. It transitions from a lower-quality representation with frequent switch points during initial buffering to a higher-quality representation with less frequent switch points once the buffer is sufficiently filled, adapting the quality level to current system state.

Inventive Principle:
Principle #15Dynamics

2Loss of time

If a representation with more frequent switch points is used for initial buffering, then buffering time is reduced and playback starts faster, but perceived quality decreases

Engineering Contradiction:
Improvebuffering timeVSAvoidperceived quality
Core Design Contradiction:
Loss of timeVSManufacturing precision

Solution Approach 1:

The system intentionally uses a lower-quality representation with more frequent switch points for preliminary buffering. This temporary compromise on quality enables faster buffering and earlier playback start, after which the system transitions to higher-quality representations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts the representation quality based on playback progress and buffer status. It starts with lower-quality representations during the initial buffering phase and transitions to higher-quality representations once sufficient data is accumulated, optimizing the trade-off between startup time and overall quality.

Inventive Principle:
Principle #15Dynamics

3Stability of the object's composition

If the system waits to switch representations until sufficient data is buffered, then playback smoothness is improved, but the ability to adapt quickly to changing bandwidth conditions is reduced

Engineering Contradiction:
Improveplayback smoothnessVSAvoidbandwidth adaptation
Core Design Contradiction:
Stability of the object's compositionVSAdaptability or versatility

Solution Approach 1:

The system implements dynamic representation switching based on real-time buffer status and network conditions. It monitors buffer levels and automatically transitions between representations with different quality levels and switch point frequencies, balancing playback smoothness with adaptability to changing bandwidth conditions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses feedback from buffer status and network condition monitoring to make intelligent switching decisions. It continuously assesses the current state and adjusts the representation selection accordingly, ensuring both smooth playback and responsive adaptation to bandwidth changes.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP2764674B1Switching between representations during network streaming of coded multimedia data
Publication Date: 2015.11.25 QUALCOMM INC
  • EP2764674B1 patent drawingFigure 1
  • EP2764674B1 patent drawingFigure 2
  • EP2764674B1 patent drawingFigure 3

AI summary

Aspects of this disclosure generally relate to a method of retrieving video data of multimedia content. In an example, the method includes determining a first interval between switch points for a first representation of the multimedia content and a second interval between switch points for a second representation of the multimedia content, wherein the first interval is less than the second interval. The method also includes, based on the determination, submitting one or more network requests for an amount of video data from the first representation that has a playback time that is at least equal to a playback time between switch points in the second representation. The method also includes, after submitting the request for the amount of video data from the first representation, retrieving video data from the second representation.