Audio-Video Transmission Ordering for Faster Random Access Playback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In existing methods for transmitting coded audio and video data using formats like MPEG-DASH and MMT, there is a delay in decoding audio data after random access due to the need for separate headers and mismatched reproduction intervals, leading to increased delay times before audio reproduction can start.
Innovation Solution
The method involves transmitting video control information first, followed by audio control information and data, ensuring the audio control information is sent after video control information, allowing decoding of audio to start simultaneously with video during random access, and using packet structures that enable calculation of audio sample reproduction times without requiring complete audio headers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If audio control information is transmitted separately from video control information, then audio and video data can be processed independently, but the delay time from reception to reproduction increases
Solution Approach 1:
The patent merges audio control information transmission with video control information transmission by sending audio control information in the same transmission时机 as video control information, specifically after video control information in the reproduction interval. This combining approach eliminates separate audio header transmission delays while maintaining independent processing capability.
Solution Approach 2:
The patent applies preliminary action by transmitting audio control information in advance within the video reproduction interval, ensuring that audio decoding can start simultaneously with video decoding. The audio control information is prepared and sent before the audio reproduction needs to start, eliminating waiting time.
2Reliability
If audio segments are subdivided to align with video reproduction intervals, then synchronization is improved, but overhead increases
Solution Approach 1:
The patent changes the parameter of audio segment boundaries by aligning audio reproduction intervals with video reproduction intervals. Instead of subdividing audio segments arbitrarily, the system adjusts audio segment parameters to match video segment boundaries, achieving synchronization without excessive subdivision and reducing overhead.
3Speed
If audio control information is transmitted before video control information, then audio decoding can start earlier, but video decoding may be delayed
Solution Approach 1:
The patent inverts the conventional approach by transmitting video control information first, then audio control information within the same reproduction interval. This reversal ensures that video decoding starts without delay while audio decoding is still enabled to start simultaneously by receiving its control information within the established video timing framework.
Data Source
AI summary
A transmitting method according to one aspect of the present disclosure includes transmitting video control information for reproduction of video data having an individually reproducible unit, transmitting the video data, determining a transmission order of audio control information for reproduction of audio data in a reproduction interval corresponding to a reproduction interval of the video data in such a way that the audio control information is transmitted after the video control information, and transmitting the audio control information according to the determined transmission order, and transmitting the audio data. Thus, in the receiving apparatus, a delay time from reception of data to reproduction of video and audio is shortened.