Video Conferencing Audio Pickup via Camera-Microphone Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
High-sensitivity microphones used in video conferencing systems capture 360-degree voices, but also pick up noises from non-participants, causing disturbances during remote conferences.
Innovation Solution
A video conferencing system and method that employs a camera device with smart framing technology and a microphone array using audio tracking to automatically limit the voice pickup area, ensuring only participant voices are captured by identifying sound source positions and transmitting relevant signals to the sound output device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If high-sensitivity microphones are used to capture 360-degree voices, then voice pickup coverage is improved, but non-participant noises are also captured causing disturbances
Solution Approach 1:
The system segments the audio space by using multiple microphones to capture voices from different directions, then processes each direction's audio separately to identify and select only participant voices while excluding non-participant noises
Solution Approach 2:
The processor acts as an intermediary between the microphone array and sound output device, analyzing audio signals from multiple microphones, determining sound source positions, and selectively transmitting only participant voices to the sound output device while filtering out non-participant noises
2Object-affected harmful factors
If audio tracking technology is used to limit voice pickup area, then non-participant noises are reduced, but system complexity increases
Solution Approach 1:
The processor performs multiple functions including receiving audio signals from multiple microphones, determining sound source positions through audio tracking, identifying which sounds originate from participant directions, and selectively transmitting appropriate audio signals - all within a single processing unit
Solution Approach 2:
The system merges the functions of multiple microphones, audio processing, position tracking, and selective audio transmission into an integrated architecture where the processor coordinates all components to achieve intelligent voice pickup without requiring separate dedicated devices for each function
Data Source
AI summary
A video conferencing system is provided, which includes at least one camera device, a microphone array device, a sound output device, and a processor. The processor is configured to: receive multiple image signals converted by an image shot by the at least one camera device, and receive multiple voice signals converted from multiple voices captured from the microphone array device; and select at least one sound source signal corresponding to multiple personnel positions from the multiple sound signals according to the image signal and the multiple voice signals, so as to transmit at least one sound source signal corresponding to the multiple personnel positions to the sound output device, where the sound output device converts at least one sound source signal into sound for play. In addition, a video conferencing method is also disclosed herein.