Spatial Audio Conferencing System Using Beamforming Microphone Arrays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In video conferencing systems, it is difficult to discern who is speaking and from which location due to the lack of spatial audio, leading to a less immersive and less clear communication experience.
Innovation Solution
The implementation of a videoconferencing system that uses a speakerphone with integrated microphones and cameras to beamform audio signals, providing directional information to recreate a stereo effect by positioning voices on the left or right side of the display, eliminating the need for separate microphones at different locations and allowing for improved audio separation and echo cancellation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple separate microphones are used at different locations to capture audio from different participants, then audio separation and spatial realism are improved, but device complexity and cost increase
Solution Approach 1:
The patent combines multiple microphone functions into a single omnidirectional microphone array. The array captures audio from all directions simultaneously, eliminating the need for multiple separate microphones positioned at different locations. This merging approach maintains audio separation capability while reducing device complexity and cost.
Solution Approach 2:
The omnidirectional microphone array serves multiple functions: it captures audio from all participants regardless of position, determines directional information through signal processing, and enables spatial audio reproduction. This multi-functional approach replaces what would traditionally require multiple specialized microphones.
2Loss of information
If directional information is added to audio signals to create stereo effect, then spatial realism and communication clarity are improved, but signal processing complexity increases
Solution Approach 1:
The patent replaces complex mechanical multi-microphone setups with signal processing techniques. By using beamforming and directional analysis on audio captured by the omnidirectional array, the system extracts spatial information through mathematical processing rather than physical microphone positioning, reducing hardware complexity while maintaining spatial fidelity.
3Reliability
If audio is reproduced from speakers positioned according to directional information, then spatial audio realism is improved, but system complexity increases
Solution Approach 1:
The patent applies local quality by directing audio signals to specific speakers based on the directional information of each participant. Audio from participants on the left side of the display is routed to left speakers, center participants to center speakers, and right participants to right speakers. This localized audio reproduction enhances spatial realism without requiring a complex distributed speaker system throughout the room.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution enhances the audio experience by providing spatially realistic audio that matches the video experience, improving audio separation and eliminating the need for multiple microphones, resulting in a more immersive and clear communication environment.
Implementation Method 1
the camera microphone array response may be beamformed to provide directional information to be sent in a side channel with the audio signal captured by the speakerphone microphones
Data Source
AI summary
In some embodiments, spatially realistic audio may be provided for a conference call. Voices from participants on the left side of a display, in a conference call, may be directed through audio on the left side of the display at the other conferencing system in the conference call (similarly for voices from the center and right side of the display). In some embodiments, two speakers may be used in the system to create synthesized stereo sound at a location specified by directional information received as side information along with the existing audio channel. The location may be determined by using beamforming with integrated microphones on a camera or speakerphone. In some embodiments, the audio signal and directional information may be sent in the form of a left audio channel and a right audio channel.