Distributed Video Mixer Processing Units for Latency Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current vision mixers for live video productions face challenges in synchronizing processing devices due to random signal latencies, leading to inconsistent video and audio frames, and require extensive hardware to manage complex functionalities, which is costly and operationally demanding.
Innovation Solution
The system splits the processing capability of a vision mixer into smaller sub-units distributed across multiple locations, using standardized IT components like servers and GPUs with high-speed data links to maintain real-time processing and synchronize signals, replacing dedicated hardware with software-based video processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If vision mixers use a huge amount of hardware components to process video signals, then multiple functionalities can be enabled, but device complexity increases and cost increases
Solution Approach 1:
The patent segments the vision mixer functionality into separate processing units distributed across multiple locations. Each processing unit handles specific video signal processing tasks independently, connected through standardized IT components and high-speed data links. This segmentation reduces the complexity of a single centralized device while maintaining multiple functionalities across the distributed system.
Solution Approach 2:
The patent implements universal processing units that can perform multiple video processing functions. These standardized units can be deployed in different locations and configured for various tasks, replacing the need for dedicated hardware components for each function. This multi-functionality approach reduces overall device complexity while maintaining versatility.
2Adaptability or versatility
If external devices are integrated to the live control environment, then processing capability is extended, but random signal latencies cause synchronization issues
Solution Approach 1:
The patent implements a feedback mechanism where the central control unit receives status information from distributed processing units and adjusts control commands accordingly. This feedback loop enables the system to compensate for signal latencies and maintain synchronization across distributed devices, ensuring reliable operation while extending processing capability.
Solution Approach 2:
The patent uses predetermined safe time periods and preparation phases before integrating external devices into the live stream. The system waits for ready status signals from external devices or applies predetermined time delays to ensure they are prepared before adding their signals to the live production stream, preventing synchronization issues.
3Reliability
If hardware devices are prepared in advance for live production, then synchronization is improved, but hardware availability decreases during waiting time
Solution Approach 1:
The patent implements dynamic resource allocation where processing units can be dynamically assigned to different tasks based on current production needs. Instead of dedicating hardware to specific functions in advance, the system can reconfigure and redistribute processing capacity dynamically, maintaining both synchronization reliability and hardware availability for various production scenarios.
Data Source
Figure 1
Figure 2A~2B
Figure 3A~3C
AI summary
A system for processing video and/or audio signals is suggested. The system comprises a control unit and a processing unit. The control unit and the processing unit are communicatively connected for exchanging digital data in a packetized format. The proposed system allows splitting the processing ability of a big vision mixer into smaller sub units without losing real-time processing behavior. In addition to that a method of processing video and/or audio signals is suggested. The method utilizes a control unit and a plurality of processing units, which are communicatively connected for exchanging digital data in a packetized format. The method comprises the steps of receiving video signals at the processing units; sending video signals from the processing units; sending command signals from the control unit to one or several processing units; and scheduling the execution of command signals received in the processing units to compensate for signal latencies and processing latencies.