Overlapping Fragment Switching for Seamless Media Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional adaptive streaming technologies face challenges in seamlessly switching between different quality versions of media streams due to temporal dependencies in video compression, leading to potential freezing or skipping of media playback when switching representations.
Innovation Solution
The method involves obtaining and decoding overlapping fragments from different representations, allowing for smooth transitions by detecting reference data points and synchronizing decoding between the two representations, either by waiting for reference data or synthesizing reference data for smoother playback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the client switches between different quality versions of media streams during playback, then the content quality can be adapted to available network throughput, but playback disruptions such as freezing or skipping may occur due to temporal dependencies in video compression
Solution Approach 1:
The system performs preliminary actions by obtaining and decoding overlapping fragments from the target representation before the actual switch occurs. This advance preparation ensures that reference data is ready and the decoder is synchronized, preventing playback disruptions when the switch happens.
Solution Approach 2:
The patent introduces an intermediary mechanism by using overlapping fragments that serve as a bridge between the current and target representations. These overlapping portions allow the decoder to transition smoothly by providing continuous reference data, acting as a mediator that connects the two different bit-rate versions without causing discontinuities.
2Device complexity
If all fragments have the same duration in conventional adaptive streaming, then the streaming structure is simplified and easier to manage, but seamless switching between representations becomes difficult due to temporal dependencies
Solution Approach 1:
The patent segments the media stream into fragments with different durations, specifically creating overlapping fragments that are longer than standard fragments. This segmentation allows the system to provide extended reference data in the overlapping regions, enabling smooth transitions between representations while maintaining the overall simplified fragment-based structure.
Solution Approach 2:
The patent applies local quality by making specific fragments (the overlapping ones) different from the standard fragments. These overlapping fragments have extended duration and contain additional reference data, creating a local variation in fragment structure precisely where it is needed for smooth switching, while other fragments maintain the standard simple structure.
Data Source
AI summary
A method and apparatus for receiving a media stream provided in a plurality of different, alternative encoded representations. Each representation comprises a series of discrete fragments and each fragment comprises a contiguous temporal segment of the stream. The method comprises: obtaining (240, 310) at least a part of a first fragment from a first one of the representations; obtaining (210, 320) at least a part of a second fragment from a second one of the representations, wherein the first and second fragments comprise temporal segments that overlap at least partially; decoding (250, 330) a first temporal segment of the media stream from the first fragment; and decoding (260, 350) a second, later temporal segment of the media stream from the second fragment. In this way, the method switches from receiving the stream in the first representation to receiving it in the second representation.