Nearby Spatial Audio Processing for XR Crosstalk and Echo

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users in extended reality (XR) environments experience acoustic issues such as improper voice hearing, undesirable crosstalk, and echo due to proximity in common physical environments, leading to inconsistent audio experiences.

Innovation Solution

A system determines user proximity and performs acoustics processing to mitigate these issues by adjusting sound, synchronizing audio dynamically, and applying DSP techniques to enhance audio consistency and reduce crosstalk.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If users are physically close in a common physical environment, then audio consistency and reduced crosstalk are improved, but acoustic issues such as echo and improper voice hearing occur

Engineering Contradiction:
Improveaudio consistencyVSAvoidacoustic crosstalk and echo
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent introduces an intermediary acoustics processing system that mediates between the audio output of multiple XR devices. This system includes acoustic models, reverberation engines, and signal processing components that act as intermediaries to simulate physical acoustic interactions, align reverberation tails, and reduce crosstalk between nearby users without requiring direct physical isolation of the audio sources.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent applies parameter changes by dynamically adjusting audio parameters such as reverberation time, echo density, and acoustic reflection characteristics based on the measured physical distance between users. The system changes these acoustic parameters in real-time to match the actual physical environment, thereby maintaining audio consistency while reducing harmful acoustic interactions between nearby users.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If acoustics processing is applied to mitigate acoustic issues, then audio consistency is improved, but system complexity increases

Engineering Contradiction:
Improveaudio consistencyVSAvoidacoustics processing system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements universality by designing a multi-functional acoustics processing system that can operate in various modes depending on the physical environment and user proximity. The same core system handles multiple tasks including echo reduction, reverberation alignment, acoustic modeling, and real-time audio adjustment, thereby reducing overall system complexity compared to having separate dedicated systems for each acoustic correction function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent applies dynamics by making the acoustics processing system adaptive and configurable based on real-time conditions. The system dynamically adjusts its processing intensity and parameters according to the measured distance between users and the detected acoustic environment, allowing it to maintain audio consistency while minimizing computational complexity in scenarios where full processing is not necessary.

Inventive Principle:
Principle #15Dynamics

3Reliability

If real-time acoustics processing is performed, then acoustic issues are mitigated, but processing time and computational resources increase

Engineering Contradiction:
Improveacoustic issue mitigationVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-computing and storing acoustic models, impulse responses, and reverberation characteristics for various common physical environments. When a user enters a new environment, the system quickly retrieves pre-computed acoustic data rather than calculating everything in real-time, significantly reducing processing time while maintaining accurate acoustic mitigation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces complex real-time acoustic measurement and computation with more efficient signal processing techniques that use pre-computed models and simplified real-time adjustments. Instead of performing full acoustic field simulations in real-time, the system uses substituted approaches such as convolving pre-computed impulse responses with current audio signals, which is computationally much lighter while achieving similar acoustic correction effects.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS20260067632A1Acoustics Processing for Nearby Spatial Audio
Publication Date: 2026.03.05 APPLE INC
  • US20260067632A1 patent drawing
  • US20260067632A1 patent drawing
  • US20260067632A1 patent drawing

AI summary

A first electronic device used by a first user can determine whether a second electronic device that is being used by a second user is located within a threshold distance of the first electronic device. The first electronic device may be presenting a first extended reality (XR) environment to the first user and the second electronic device may be presenting a second XR environment to the second user. The first electronic device, in response to the second electronic device being located within the threshold distance, can perform acoustics processing for nearby spatial audio. For example, the first electronic device can play a voice of the second user with a sound adjustment. Other aspects are also described and claimed.