Audio-Video Stream Header Ordering for Low-Latency Random Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In existing methods for transmitting coded audio and video data using formats like MPEG-DASH and MMT, there is a delay in decoding audio data after random access due to the need for obtaining headers of segments, leading to prolonged delay times before audio reproduction can start.
Innovation Solution
The method involves transmitting video control information first, followed by audio control information and data, ensuring the audio control information is transmitted after the video control information, allowing audio decoding to start simultaneously with video decoding during random access, and using packet structures that enable audio decoding without requiring complete header information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If audio control information is transmitted separately from video control information, then audio and video can be processed independently, but the delay time from reception to reproduction increases
Solution Approach 1:
The patent combines audio control information and video control information into the same data structure (MPU header), allowing them to be transmitted together in a unified manner. This merging eliminates the need for separate transmission channels and reduces the overall delay time from reception to reproduction, while maintaining the ability to process audio and video independently through their respective control information fields.
2Reliability
If audio segments are subdivided to align with video reproduction intervals, then synchronized reproduction is achieved, but overhead increases
Solution Approach 1:
The patent includes preliminary timing information (reproduction time stamps) within the MPU header that allows the receiving apparatus to determine audio sample reproduction times in advance without requiring subdivision of audio segments. This preliminary action enables synchronized reproduction by providing all necessary timing data upfront, eliminating the need for post-reception segmentation and reducing overhead.
3Manufacturing precision
If complete header information is transmitted for audio decoding, then accurate reproduction is achieved, but transmission efficiency decreases
Solution Approach 1:
The patent extracts only the essential timing information (reproduction time stamps) from the complete audio header and places it in the MPU header. This extraction allows the receiving apparatus to calculate audio sample reproduction times without requiring the full header information to be transmitted. The result is accurate reproduction timing achieved with minimal transmission data, improving efficiency while maintaining precision.
Data Source
AI summary
A transmitting method according to one aspect of the present disclosure includes transmitting video control information for reproduction of video data having an individually reproducible unit, transmitting the video data, determining a transmission order of audio control information for reproduction of audio data in a reproduction interval corresponding to a reproduction interval of the video data in such a way that the audio control information is transmitted after the video control information, and transmitting the audio control information according to the determined transmission order, and transmitting the audio data. Thus, in the receiving apparatus, a delay time from reception of data to reproduction of video and audio is shortened.