Shared Video Stream Synchronization for Multi-Source Conference Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing digital video conference systems face challenges in producing a well-formed user experience due to latency, synchronization, encoding format differences, frame rate and resolution variations, and variable connectivity issues when handling multiple input streams, especially in complex meetings involving diverse hardware and software.
Innovation Solution
A system and method for producing a digital video stream that includes collecting, time-synchronizing, pattern detecting, and publishing multiple input streams using a central server with functions for format-specific collecting, event and pattern detection, and introducing controlled latency to create a synchronized and pattern-based output stream.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple digital video streams with different latencies, frame rates, and resolutions are processed in real-time, then the system can provide comprehensive multi-source video content, but the latency increases and synchronization becomes difficult
Solution Approach 1:
The system performs preliminary actions by collecting and buffering video frames from multiple sources before production. Frames are stored in buffers with associated timestamps, allowing the system to prepare synchronized frames in advance without waiting for all sources to be ready simultaneously, thus reducing latency while maintaining synchronization.
Solution Approach 2:
The patent introduces an intermediary production system that mediates between multiple video sources and the final output. This production system includes components that collect frames, detect patterns, select appropriate frames based on detected patterns, and assemble the final stream, acting as a buffer and synchronization layer between diverse input sources and the output.
2Reliability
If digital video streams from different sources are time-synchronized, then the user experience improves, but the complexity of the system increases due to buffering and frame alignment requirements
Solution Approach 1:
The system segments the video processing task into distinct functional components: collection of frames from multiple sources, detection of patterns in the video content, selection of appropriate frames based on detected patterns, and assembly of the final synchronized stream. This segmentation allows each component to be optimized independently and simplifies the overall system architecture.
Solution Approach 2:
The patent changes parameters by associating timestamps with video frames and using these timestamps for synchronization. The system detects patterns by analyzing video content and uses these patterns to dynamically select frames for the output stream, changing from a static frame selection approach to a dynamic pattern-based selection that adapts to the actual video content.
3Loss of time
If video frames are buffered to ensure synchronization, then time alignment improves, but memory requirements and processing overhead increase
Solution Approach 1:
The system applies partial action by buffering only the necessary number of frames required for synchronization rather than buffering entire video streams. Frames are buffered with associated timestamps, and only the minimal required buffer size is maintained to achieve synchronization, reducing memory requirements while ensuring proper time alignment.
Data Source
AI summary
Methods and systems, including computer software products, for providing a shared digital video stream. Primary digital video streams are collected from at least two digital video sources. The primary streams are individually analysed to detect at least one event. The primary streams are time-synchronised with respect to a common time reference. The time-synchronised primary streams are analysed to detect at least one pattern. The pattern detection is based on the detected event, firstly, video and/or audio information in at least two time-synchronised of the primary streams considered jointly or, secondly, video and/or audio information in a single primary stream spanning across at least two detected events. The shared stream is produced as an output digital video stream based on consecutively considered frames of the time-synchronised primary streams and the detected patterns. The output stream is continuously provided to a consumer of the shared digital video stream.