Active Speaker View Generation Using In-Room User Cameras
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional conference rooms are equipped with limited cameras that provide a general view of the room rather than detailed viewpoints of individual users, limiting remote participants' ability to perceive important details like body language and facial expressions of active speakers.
Innovation Solution
A videoconference system automatically detects and connects with user devices in the room, determines their positions, and selects video content from these devices to generate a detailed view of the active speaker, enhancing the video output for remote participants.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a single camera is used to capture all users in the conference room, then the system complexity is reduced and ease of operation is improved, but the measurement precision of individual user details deteriorates
Solution Approach 1:
The patent divides the video capture function into multiple segments: the main conference room camera provides overall coverage, while individual user devices (smartphones, tablets, laptops) capture detailed views of specific users. This segmentation allows each device to focus on its optimal capture zone, with the system dynamically selecting and combining these segmented views to produce high-quality detailed shots of active speakers without requiring a single complex camera system
Solution Approach 2:
The patent makes user devices serve multiple functions: they act as both personal computing devices for users and as auxiliary video capture devices for the conference system. By utilizing the existing cameras and sensors in ubiquitous user devices, the system achieves detailed video capture capability without adding dedicated hardware, thus improving measurement precision while maintaining ease of operation
2Measurement precision
If multiple user devices are detected and connected to capture detailed video, then the measurement precision of active speaker details is improved, but the device complexity increases
Solution Approach 1:
The patent implements self-service mechanisms where user devices automatically detect themselves in the conference room via Bluetooth or Wi-Fi scanning, automatically connect to the conference system, and automatically have their video feeds integrated. The system autonomously identifies active speakers through audio analysis and automatically selects appropriate video sources, eliminating the need for manual device configuration or operator intervention despite the complexity of managing multiple devices
Solution Approach 2:
The patent introduces a conference system server as an intermediary that manages the complexity of coordinating multiple user devices. This intermediary handles device discovery, connection management, video feed aggregation, and active speaker detection, shielding individual users from the underlying system complexity while enabling high-precision detailed video capture through coordinated multi-device operation
Data Source
AI summary
A videoconference system is described that generates a video for a room including multiple videoconference participants and outputs the video as part of the videoconference. The videoconference system is configured to generate the video as including a detailed view of one of the multiple videoconference participants located in the room. To do so, the videoconference system detects user devices located in the room capable of capturing video and determines a position of each user device. The videoconference system then detects a user speaking in the room and determines a position of the active speaker. At least one of the user devices is identified as including a camera oriented for capturing the active speaker. Video content captured by one or more user devices is then processed by the videoconference system to generate a detailed view of the active speaker.