Audio Primer Time-Stamp Management for Fast Media Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Deep pipelining and buffering in video decoding systems cause noticeable delays when switching between multiple audio tracks, as the audio decoder must wait for the buffer to fill again to synchronize with the video, leading to interruptions or glitches in playback.
Innovation Solution
Employing audio primers to manage time-stamps for undecoded audio streams, allowing for immediate decoding and synchronization without disrupting video playback, even when not enough audio decoders are available.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If deep pipelining and buffering are used in video decoding systems, then playback stability is improved, but switching delay between audio tracks increases
Solution Approach 1:
The patent applies preliminary action by pre-decoding audio frames in advance and storing them in buffers before they are needed for playback. When an audio track switch is requested, the pre-decoded frames are already available in the buffer, allowing immediate switching without waiting for the buffer to refill. This resolves the contradiction by preparing data beforehand, thus maintaining playback stability while eliminating switching delay.
2Adaptability or versatility
If audio decoder is stopped to switch between audio tracks, then track switching is enabled, but audio synchronization with video is disrupted
Solution Approach 1:
The patent pre-decodes and stores audio frames in buffers before switching is needed. When switching between audio tracks, the decoder continues running in the background preparing frames, so the switch can occur immediately without stopping the decoder, thereby maintaining audio-video synchronization while enabling track switching capability.
Solution Approach 2:
The patent maintains continuous operation of the audio decoder even during track switching. The decoder keeps processing audio frames and filling buffers in the background, ensuring that the useful action of decoding continues uninterrupted. This allows seamless switching between audio tracks while preserving synchronization with video playback.
Data Source
AI summary
Disclosed are various embodiments that facilitate fast switching of synchronized media using time-stamp management. A first media stream and multiple second media streams are obtained. The second media stream is time synchronized to the first media stream. The first media stream and one of the second media streams are decoded. Time-stamp management without decoding is performed for another one of the second media streams to facilitate fast switching to the other one of the second media streams when desired.