Audio Video Stream Synchronization via Chunk Buffering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video conferencing technologies face challenges in synchronizing and mixing audio and video streams over networks, leading to potential delays and desynchronization issues that can hinder communication.
Innovation Solution
The solution involves buffering and managing audio streams in chunks, synchronizing them with video streams by comparing time markers, and using a mix-open and mix-close approach to ensure all streams are synchronized before display, which can be implemented on clients or servers, or a combination of both.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If audio streams are transmitted over network without buffering and mixing, then transmission speed is improved, but synchronization between audio and video deteriorates
Solution Approach 1:
The patent applies preliminary action by buffering audio chunks before mixing and synchronization. Audio chunks are collected and stored in buffers ahead of time, allowing the system to process and synchronize them with video streams at the appropriate moment, thus maintaining both transmission speed and synchronization precision.
Solution Approach 2:
The patent segments audio streams into discrete chunks that can be independently buffered, mixed, and synchronized. This segmentation allows the system to manage audio data in manageable units, enabling precise timing control and synchronization with video frames without compromising overall transmission efficiency.
2Manufacturing precision
If audio chunks are buffered and mixed before display, then synchronization between audio and video is improved, but processing time increases
Solution Approach 1:
The system performs preliminary buffering of audio chunks and pre-computation of synchronization parameters before the actual display moment. This allows the heavy processing work to be done in advance, reducing the processing time burden during real-time display while maintaining high synchronization precision.
Solution Approach 2:
The patent implements continuous buffering and pre-processing of audio streams alongside video stream reception. This continuous useful action ensures that audio and video are always ready for synchronization without idle waiting time, optimizing the balance between processing time and synchronization accuracy.
3Reliability
If all audio streams are mixed before display, then audio completeness is improved, but delay in audio playback increases
Solution Approach 1:
The system buffers audio chunks in advance and performs preliminary mixing operations before the required playback moment. By preparing the audio mix in advance, the system ensures audio completeness from all participants while minimizing actual playback delay, as the mixed audio is ready for immediate output.
4Measurement precision
If audio synchronization is performed strictly, then communication accuracy is improved, but system complexity increases
Solution Approach 1:
The patent segments the complex audio synchronization task into discrete, manageable operations: chunk collection, buffer management, timing calculation, and mixing. This segmentation breaks down the complex synchronization process into simpler steps that can be implemented systematically, reducing overall system complexity while maintaining high synchronization accuracy.
Solution Approach 2:
The patent introduces intermediate buffering structures and timing mechanisms that act as mediators between audio stream reception and final mixing. These intermediary components simplify the synchronization process by providing standardized interfaces and controlled timing, reducing the complexity of direct audio-video synchronization.
Data Source
AI summary
In one aspect, audio streams are added to a mix until the mix is either complete (i.e., all audio streams have been added) or the mix is closed early (i.e., before the mix is complete). In another aspect, audio and video streams are synchronized by playing back the audio stream and then synchronizing display of the video frames to the playback of the audio stream.