Room Intelligence Camera Tracking Through Acoustic Coordinate Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conferencing environments face challenges in accurately correlating camera angles with talker positions due to unknown or undefined relative positions of cameras and microphones, making it difficult to modify camera zones post-setup and requiring professional intervention.
Innovation Solution
Systems and methods convert microphone array locations, lobe locations, and talker locations into a common coordinate system, enabling cameras to generate presets and adjust parameters based on these converted locations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If manual configuration of camera zones by professional installer is used, then camera can be configured to show specific portions of room, but installation time and complexity increase
Solution Approach 1:
The system performs automatic camera zone configuration using acoustic signals from the microphone array. The camera controller autonomously determines talker positions based on acoustic data and automatically configures camera zones and presets without requiring professional installer intervention, thereby reducing installation time while maintaining configuration accuracy
Solution Approach 2:
The patent replaces manual mechanical configuration processes with automated acoustic-based positioning. The microphone array captures acoustic signals to determine talker locations, which are then used by the camera controller to automatically configure camera zones, substituting the manual mechanical adjustment process with an automated acoustic field-based system
2Reliability
If pre-configured camera zones are used during initial setup, then camera coverage can be optimized for initial seating arrangement, but system becomes inflexible when seating changes
Solution Approach 1:
The system dynamically adjusts camera zones and presets based on real-time acoustic data from the microphone array. When talker positions change, the camera controller continuously updates camera zone configurations and presets to maintain optimal coverage, transforming the static pre-configured system into a dynamic adaptive system
Solution Approach 2:
The system uses feedback from the microphone array's acoustic data to continuously monitor and adjust camera configurations. The camera controller receives ongoing acoustic information about talker positions and automatically updates camera zones and presets accordingly, ensuring the system adapts to seating changes while maintaining reliable coverage
3Area of stationary object
If multiple cameras and microphones are deployed for adequate coverage, then video and audio coverage improves, but coordinate correlation between cameras and microphones becomes complex
Solution Approach 1:
The camera controller serves multiple functions: it controls camera operations, processes acoustic data from the microphone array, performs coordinate transformations, and manages camera zone configurations. This multi-functional approach simplifies the overall system architecture by consolidating coordination tasks in a single controller, reducing the complexity of inter-device coordinate correlation
Solution Approach 2:
The camera controller acts as an intermediary between the microphone array and the camera system. It receives acoustic data from the microphone array, performs coordinate transformations to align the coordinate systems, and uses this information to control camera positioning and zoom, thereby simplifying the correlation complexity between multiple devices
4Measurement precision
If professional installer manually configures zones based on microphone array location, then accurate camera-talker correlation can be achieved, but labor costs and setup time increase
Solution Approach 1:
The system automatically performs camera-talker correlation using acoustic signals from the microphone array. The camera controller autonomously determines talker positions based on acoustic data and configures camera zones and presets without requiring professional installer intervention, thereby maintaining correlation accuracy while significantly improving setup ease
Solution Approach 2:
The patent replaces manual mechanical configuration processes with automated acoustic-based positioning. The microphone array captures acoustic signals to determine talker locations, which are then used by the camera controller to automatically configure camera zones, substituting the manual configuration process with an automated acoustic field-based system
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Reduces the time and effort required for installation and configuration, allowing cameras to accurately capture active talkers and improve user satisfaction.
Implementation Method 1
detecting, using a microphone array and based on an acoustical trigger from or near a camera, a camera location
Implementation Method 2
converting, using the microphone array and based on the camera location, the camera location in the first coordinate system into a microphone array location in a second coordinate system
Data Source
AI summary
Conferencing systems and methods configured to generate true talker coordinates for use in camera tracking of talkers and objects in an environment and other room intelligence use cases are disclosed. The initial configuration and ongoing usage of conferencing systems can be improved by detecting and converting the locations of objects and talkers in an environment into a common coordinate system. The amount of time and effort by installers, integrators, and users, can be reduced leading to increased satisfaction with installation and usage of the conferencing system.