Conference Bridge Spatial Audio Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional audio conferencing systems fail to provide immersive, spatialized listening experiences for multi-site and multi-user setups, limiting the ability to accurately locate speakers and differentiate them by site, and are not scalable to extend the number of speakers or sites.
Innovation Solution
A method and system that utilize binaural microphones and a conference bridge to process and combine audio signals from multiple sites, applying site-specific processing functions to create a hybrid spatialized audio scene that allows for accurate speaker localization and site differentiation, using a communication module to receive and decompress signals, and a processing module to determine and apply weighting functions to form a hybrid two-channel signal for each conference station.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional audio conferencing systems are used, then system simplicity is maintained, but immersive spatialized listening experience and speaker localization capability are lost
Solution Approach 1:
The system segments the audio processing by separating binaural microphone capture at each conference station from the hybrid spatial scene creation at the conference bridge. Each station independently captures spatial audio with binaural microphones, and the bridge combines these segmented spatial signals to create the immersive experience, resolving the contradiction between localization accuracy and system complexity.
Solution Approach 2:
The conference bridge acts as an intermediary that receives two-channel binaural signals from multiple conference stations, applies site-specific processing functions, and synthesizes hybrid spatialized audio scenes. This intermediary role enables accurate speaker localization without requiring each station to independently process all incoming signals, managing system complexity while maintaining reliability.
2Reliability
If artificial conference scenes are created using HRTF filters, then spatialized listening is achieved, but natural realism and listening comfort are reduced
Solution Approach 1:
The system merges naturally captured binaural audio signals from multiple conference stations to create hybrid spatialized audio scenes. Instead of applying artificial HRTF filters to monophonic signals, the system combines authentic spatial recordings directly captured by binaural microphones, preserving natural realism while maintaining spatialized listening capability and comfort.
Solution Approach 2:
The system uses actual binaural recordings captured by microphones positioned on mannequin heads as copies of real spatial audio scenes. These authentic spatial copies are transmitted and combined at the conference bridge, providing natural realism without requiring artificial HRTF filtering, thus improving listening comfort while maintaining spatialized capability.
3Adaptability or versatility
If a single speaker is present in each conference room, then artificial scene creation is possible, but scalability to multiple speakers and sites is limited
Solution Approach 1:
The system dynamically adapts to varying numbers of speakers and conference stations by processing two-channel binaural signals from each station independently. The conference bridge applies site-specific processing functions that automatically adjust based on the number of active participants, enabling scalable multi-site multi-user conferences without fixed limitations on speaker count or site number.
Solution Approach 2:
The binaural microphone system and hybrid spatial scene creation methodology serve multiple functions: they capture spatial audio for single or multiple speakers, support any number of conference stations, and provide both speaker localization and natural realism. This universal approach eliminates the single-speaker limitation while managing processing complexity through efficient signal combination at the conference bridge.
4Loss of information
If monophonic signals are transmitted to each conference site, then system simplicity is maintained, but speaker localization and site differentiation are lost
Solution Approach 1:
Spatial audio information is captured in advance using binaural microphones at each conference station before transmission. The two-channel binaural signals preserve spatial characteristics including interaural time and level differences, ensuring spatial information is retained during transmission without requiring complex real-time processing at the receiving end, thus balancing information retention with processing complexity.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The invention relates to a conference bridge for a conference system comprising a plurality of conference stations, characterized in that it includes: - means for receiving two-channel audio signals from the conference stations; - means for determining at least one processing function per conference station of the conference system; - means for applying the respective weighting functions to the received two-channel signals; - means for generating (330) a hybrid two-channel signal to be transmitted by each conference station by means of summing a portion of the processed two-channel audio signals; - means for transmitting (310) the respective hybrid two-channel audio signal to the various conference stations of the conference system. The invention also relates to a method for transmitting a spatialized audio scene implemented by a conference bridge according to the invention.