Talker Tracking Camera Positioning Using Multi-Microphone Coordinates
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conferencing environments face challenges in accurately identifying and tracking talkers due to difficulties in correlating camera angles with talker positions, especially when seating arrangements change, and manual configuration by professionals is time-consuming and inflexible.
Innovation Solution
Systems and methods use multiple microphones to determine talker locations, adjust microphone lobes, and select cameras for optimal positioning based on audio localization, enabling automatic camera pointing and microphone beam steering without manual intervention.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If multiple cameras and microphones are used for adequate coverage, then video and audio coverage is improved, but difficulty in accurately identifying unique talkers and correlating camera angles with talker positions increases
Solution Approach 1:
The patent introduces a coordinate transformation system as an intermediary that bridges the gap between microphone array coordinate systems and camera coordinate systems. This intermediary layer enables accurate correlation of talker positions across multiple devices by converting coordinates to a common reference frame, thereby resolving the difficulty in identifying talkers and correlating positions when multiple cameras and microphones are deployed
2Measurement precision
If professional installer manually configures zones or presets for cameras, then camera positioning accuracy is improved, but installation time and labor requirements increase
Solution Approach 1:
The patent implements self-service configuration where the conferencing system automatically determines optimal camera zones and presets based on real-time talker location data from the microphone array. The system performs manual configuration tasks autonomously by analyzing audio signals, identifying talker positions, and automatically adjusting camera settings without requiring professional installers, thereby reducing installation time while maintaining positioning accuracy
Solution Approach 2:
The system performs preliminary configuration by pre-establishing the relationship between microphone array coordinate systems and camera coordinate systems during setup. This preliminary action enables automatic zone and preset determination in the future without requiring reconfiguration, allowing the system to adapt to seating changes automatically while maintaining accuracy
3Measurement precision
If pre-configured camera zones are set up manually, then initial camera positioning is improved, but flexibility to adapt to seating arrangement changes decreases
Solution Approach 1:
The patent transforms static pre-configured camera zones into dynamic, real-time zones that automatically adapt to changing seating arrangements. The system continuously updates camera zones based on real-time talker location data from the microphone array, enabling the camera positioning to dynamically respond to participant movements and reconfigurations while maintaining accuracy without manual intervention
4Area of stationary object
If camera is configured to show entire room or fixed on specific portion, then camera coverage is improved, but ability to track moving talkers deteriorates
Solution Approach 1:
The patent implements dynamic camera positioning where the camera automatically tracks moving talkers by receiving real-time location data from the microphone array. The camera transitions from static fixed or wide-angle configurations to dynamic tracking mode, continuously adjusting its focus and position to follow talkers as they move throughout the room, thereby maintaining the ability to detect and track talkers while preserving adequate coverage
Data Source
AI summary
Conferencing systems and methods configured to generate talker coordinates for directing a camera towards talker locations in an environment are disclosed, as well as talker tracking using multiple microphones and multiple cameras. One method includes determining, using a first microphone array and based on audio associated with a talker, a first talker location in a first coordinate system relative to the first microphone array; determining, using a second microphone array and based on the audio associated with the talker, a second talker location in a second coordinate system relative to the second microphone array; determining, based on the first talker location and the second talker location, an estimated talker location in a third coordinate system relative to a camera; and transmitting, to the camera, the estimated talker location in the third coordinate system to cause the camera to point the camera towards the estimated talker location.