Video Layout Modes for Multi-Screen Speaker Identification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current videoconferencing systems face challenges in dynamically selecting and prominently displaying the active speaker across multiple screens in multi-camera, multi-site environments, leading to user disorientation and suboptimal speaker switching, especially when endpoints have different camera configurations and output varying video streams.
Innovation Solution
The introduction of two new videoconference layout modes: 'Speaker Priority' and 'Participant Priority', where 'Speaker Priority' ensures the current speaker's video streams are displayed prominently on reserved screens based on the number of cameras and display devices, and 'Participant Priority' optimizes the display of all participants across grid screens, minimizing disruption and maximizing visibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If multiple video streams are received from each endpoint, then more participant views are available, but the MCU cannot determine which video stream includes the current speaker
Solution Approach 1:
The system uses audio activity detection to provide feedback about which endpoint contains the current speaker. The MCU analyzes audio signals from each endpoint and uses this feedback information to automatically select and prioritize video streams from the active speaker's endpoint, resolving the ambiguity of which video stream to display prominently.
Solution Approach 2:
An audio analysis intermediary is introduced between the multiple video streams and the display selection process. This intermediary analyzes audio activity at each endpoint and provides guidance on which video stream should be prioritized, acting as a mediator that connects audio information to video display decisions.
2Ease of operation
If current layout management tools are used, then basic video display is achieved, but active speaker may not be shown prominently and users become disoriented
Solution Approach 1:
The layout management system transitions from static, pre-configured layouts to dynamic layouts that automatically adjust based on real-time audio activity detection. The system continuously monitors which endpoint has the active speaker and dynamically reconfigures the video display to prominently feature that speaker, ensuring reliable speaker visibility while maintaining ease of operation.
Solution Approach 2:
The system implements self-service layout optimization by automatically detecting audio activity and adjusting video stream prioritization without requiring manual administrator intervention. The layout management tool monitors audio signals and autonomously determines the optimal display configuration, making the system self-adjusting and reliable.
3Adaptability or versatility
If active speaker locations move around frequently, then all participants can be shown, but users become disoriented and unsure where to focus
Solution Approach 1:
The system performs preliminary actions by maintaining consistent visual anchors and transition protocols before and during speaker switching. When the active speaker changes, the system prepares and executes smooth, predictable transitions rather than abrupt changes, maintaining layout stability and user orientation while adapting to different speakers.
Data Source
AI summary
A videoconferencing device that determines a spatial arrangement of the video streams output at a first endpoint based on a number of display devices being utilized at the first endpoint and a number of cameras being utilized at each of the one or more additional endpoints.