Video Stream Synchronization Using Common Time Reference
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing digital video conference systems face challenges in producing a seamless digital video stream due to issues like latency, synchronization, varying frame rates, aspect ratios, and resolutions, as well as participant connectivity changes.
Innovation Solution
A system and method for producing a digital video stream by collecting input streams from multiple sources, synchronizing them, and automatically detecting triggers such as gaze direction or gestures to alter the production mode of the shared digital video stream.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple digital video streams with different latencies, frame rates, aspect ratios or resolutions are processed in real-time, then the user experience is improved, but the system complexity and processing requirements increase
Solution Approach 1:
The patent introduces a common time reference as an intermediary that mediates between multiple video streams with different characteristics. This time reference acts as a universal synchronization point that allows streams with varying latencies, frame rates, and resolutions to be coordinated without requiring complex pairwise synchronization logic.
Solution Approach 2:
The system dynamically adjusts timing parameters of individual video streams based on their characteristics relative to the common time reference. By changing the timing parameters (delays, frame rates) of each stream individually, the system achieves synchronization across diverse video sources without increasing overall system complexity.
2Adaptability or versatility
If digital video streams are decoded and re-encoded to handle different encodings or formats, then format compatibility is improved, but latency and computational cost increase
Solution Approach 1:
The patent performs decoding and format conversion as preliminary actions before the video streams are fully processed and distributed. By completing format standardization early in the pipeline and synchronizing to a common time reference, the system minimizes the impact of these computationally intensive operations on overall latency.
3Manufacturing precision
If memory allocation is continuously balanced to handle varying frame rates, aspect ratios and resolutions, then video quality is improved, but additional latency and synchronisation problems occur
Solution Approach 1:
The system performs preliminary memory allocation based on the characteristics of each video stream relative to the common time reference. By pre-allocating memory buffers according to known stream parameters before processing begins, the system avoids continuous reallocation during operation, thereby maintaining video quality while reducing latency introduced by dynamic memory management.
Data Source
AI summary
Methods and systems for generating an output digital video stream. A real-time primary digital video stream is continuously captured and analyzed to detect events or patterns. A first analysis identifies a first event, establishing a first production control parameter after a short delay. A second image or audio analysis, detecting a second event, establishes a second production control parameter after a longer delay. Both control parameters modify the primary video stream, ensuring that adjustments based on the second parameter are applied without introducing additional delay. This produces a modified digital video stream, continuously provided to at least one client. The primary video stream is captured locally, with the first analysis and initial modifications performed locally, while the second analysis is performed remotely. This approach enables real-time content modification without delaying the output stream.