Active Speaker View Generation Using In-Room Device Cameras
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional conference rooms with a single camera provide a limited view of active speakers, restricting remote participants' ability to perceive important details like body language and facial expressions.
Innovation Solution
A videoconference system automatically detects and connects with user devices in the room, determines their positions, and selects video from these devices to generate a detailed view of the active speaker, enhancing the video output with improved detail.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single camera is used in the conference room, then the device complexity is reduced, but the video detail quality for remote participants deteriorates
Solution Approach 1:
The system segments the video capture function by utilizing multiple user devices (laptops, smartphones, tablets) already present in the conference room, rather than relying on a single dedicated camera. Each device captures video from its own perspective, and the system segments the task of providing video detail across multiple sources.
Solution Approach 2:
The system makes user devices multi-functional by having them serve both their original purposes and as video capture devices for the conference system. These devices universally perform multiple roles: personal computing tasks and conference video acquisition, eliminating the need for dedicated single-function conference cameras.
2Area of stationary object
If a single camera providing a wide view is used, then all users can be captured, but the detailed view of individual speakers is lost
Solution Approach 1:
The system dynamically selects and switches between video sources from multiple user devices based on who is speaking. The video feed is not static but adapts in real-time to highlight the active speaker, providing detailed views when needed while maintaining the ability to show wide views when appropriate.
Solution Approach 2:
The system introduces an intermediary layer (the video selection and processing system) that mediates between the multiple video sources from user devices and the final conference video output. This intermediary selects, processes, and combines video feeds to provide both wide coverage and detailed speaker views.
3Loss of information
If multiple user devices are utilized for video capture, then the video detail quality improves, but the device complexity and system complexity increase
Solution Approach 1:
The system leverages the self-service capability of user devices that already have cameras and processing power. Instead of requiring a complex dedicated camera system, the system uses the existing self-sufficient video capture capabilities of participant devices, reducing overall system complexity while improving video quality.
Solution Approach 2:
The system creates video copies from multiple user devices and processes these copies to generate the final conference video. Rather than using a single original video source, it utilizes replicated video feeds from multiple devices, selecting and combining the most relevant copies for the final output.
4Ease of operation
If the system automatically selects video from user devices, then the ease of operation improves, but the extent of automation increases system complexity
Solution Approach 1:
The system uses feedback from audio analysis (detecting who is speaking) to automatically control video selection. The audio input provides feedback about the active speaker, which the system uses to automatically switch video feeds, creating a closed-loop system that simplifies operation through automated decision-making.
Solution Approach 2:
The system replaces manual mechanical video switching with automated electronic selection based on audio detection. Instead of operators physically switching cameras or manually selecting feeds, the system electronically automatically selects video sources based on real-time audio analysis of speaker identification.
Data Source
AI summary
A videoconference system is described that generates a video for a room including multiple videoconference participants and outputs the video as part of the videoconference. The videoconference system is configured to generate the video as including a detailed view of one of the multiple videoconference participants located in the room. To do so, the videoconference system detects user devices located in the room capable of capturing video and determines a position of each user device. The videoconference system then detects a user speaking in the room and determines a position of the active speaker. At least one of the user devices is identified as including a camera oriented for capturing the active speaker. Video content captured by one or more user devices is then processed by the videoconference system to generate a detailed view of the active speaker.