Nearby Spatial Audio Processing for XR Crosstalk and Echo
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users in extended reality (XR) environments experience acoustic issues such as improper voice hearing, undesirable crosstalk, and echo due to proximity in common physical environments, leading to inconsistent audio experiences.
Innovation Solution
A system determines user proximity and performs acoustics processing to mitigate these issues by adjusting sound, synchronizing audio dynamically, and applying DSP techniques to enhance audio consistency and reduce crosstalk.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If users are physically close in a common physical environment, then audio consistency and reduced crosstalk are improved, but acoustic issues such as echo and improper voice hearing occur
Solution Approach 1:
The patent introduces an intermediary acoustics processing system that mediates between the audio output of multiple XR devices. This system includes acoustic models, reverberation engines, and signal processing components that act as intermediaries to simulate physical acoustic interactions, align reverberation tails, and reduce crosstalk between nearby users without requiring direct physical isolation of the audio sources.
Solution Approach 2:
The patent applies parameter changes by dynamically adjusting audio parameters such as reverberation time, echo density, and acoustic reflection characteristics based on the measured physical distance between users. The system changes these acoustic parameters in real-time to match the actual physical environment, thereby maintaining audio consistency while reducing harmful acoustic interactions between nearby users.
2Reliability
If acoustics processing is applied to mitigate acoustic issues, then audio consistency is improved, but system complexity increases
Solution Approach 1:
The patent implements universality by designing a multi-functional acoustics processing system that can operate in various modes depending on the physical environment and user proximity. The same core system handles multiple tasks including echo reduction, reverberation alignment, acoustic modeling, and real-time audio adjustment, thereby reducing overall system complexity compared to having separate dedicated systems for each acoustic correction function.
Solution Approach 2:
The patent applies dynamics by making the acoustics processing system adaptive and configurable based on real-time conditions. The system dynamically adjusts its processing intensity and parameters according to the measured distance between users and the detected acoustic environment, allowing it to maintain audio consistency while minimizing computational complexity in scenarios where full processing is not necessary.
3Reliability
If real-time acoustics processing is performed, then acoustic issues are mitigated, but processing time and computational resources increase
Solution Approach 1:
The patent applies preliminary action by pre-computing and storing acoustic models, impulse responses, and reverberation characteristics for various common physical environments. When a user enters a new environment, the system quickly retrieves pre-computed acoustic data rather than calculating everything in real-time, significantly reducing processing time while maintaining accurate acoustic mitigation.
Solution Approach 2:
The patent replaces complex real-time acoustic measurement and computation with more efficient signal processing techniques that use pre-computed models and simplified real-time adjustments. Instead of performing full acoustic field simulations in real-time, the system uses substituted approaches such as convolving pre-computed impulse responses with current audio signals, which is computationally much lighter while achieving similar acoustic correction effects.
Data Source
AI summary
A first electronic device used by a first user can determine whether a second electronic device that is being used by a second user is located within a threshold distance of the first electronic device. The first electronic device may be presenting a first extended reality (XR) environment to the first user and the second electronic device may be presenting a second XR environment to the second user. The first electronic device, in response to the second electronic device being located within the threshold distance, can perform acoustics processing for nearby spatial audio. For example, the first electronic device can play a voice of the second user with a sound adjustment. Other aspects are also described and claimed.


