Location-Based Audio Filtering for AR Immersion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Augmented reality experiences are hindered by real-world sounds that do not align with the computer-generated imagery, leading to user distraction due to the mismatch between perceived and acoustic environments.

Innovation Solution

A method that selectively filters real-world audio based on the user's location using microphones and a sound processing system, applying filters to enhance the audio signal with effects like reverberation or echo, ensuring it aligns with the AR experience, thereby immersing the user more fully.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If real-world audio is captured and played back during AR experience, then the user can hear environmental sounds, but the sounds do not align with the computer-generated imagery and distract the user

Engineering Contradiction:
Improvealignment between audio and visual AR experienceVSAvoiduser distraction from mismatched sounds
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent extracts and removes unwanted real-world audio components that do not align with the AR experience. The sound processing system identifies and filters out distracting sounds from the captured environmental audio, separating them from desirable sounds that should be preserved in the augmented audio output.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies different audio filters selectively based on the user's location and the specific AR experience context. Different filtering characteristics are applied to different audio sources or time periods, allowing the system to preserve certain environmental sounds while removing others, creating location-specific audio quality that matches the visual AR content.

Inventive Principle:
Principle #3Local quality

2Reliability

If filters are applied to modify real-world audio to match AR experience, then user immersion is improved, but the audio processing complexity increases

Engineering Contradiction:
Improveuser immersion in AR experienceVSAvoidaudio processing system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies audio filters in advance to the captured environmental audio before it is mixed with generated audio content. By pre-processing the real-world audio with appropriate filters based on the AR experience type and user location, the system simplifies the overall processing pipeline and reduces real-time computational complexity while maintaining immersion quality.

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If location-based filtering is implemented to synchronize audio with AR environment, then audio consistency is improved, but the processing requirements and system complexity increase

Engineering Contradiction:
Improveaudio-environment synchronization accuracyVSAvoidsound processing system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The sound processing system automatically selects and applies appropriate filters based on the user's current location and the AR experience context without requiring manual intervention. The system self-adjusts the audio filtering parameters by monitoring location data and automatically configuring the audio processing pipeline, reducing the perceived complexity for the user while maintaining high synchronization accuracy.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution effectively synchronizes real-world audio with the AR environment, enhancing the user's experience by making it consistent with the virtual elements, thus improving immersion and engagement.

Implementation Method 1

the filter can be designed to add reverberation, an echo, etc. to the audio signal

Methodology Applied
Scientific EffectReverberation: Reverberation

Implementation Method 2

the filter can be designed to add reverberation, an echo, etc. to the audio signal

Methodology Applied
Scientific EffectEcho: Echo

Data Source

PatentUS10031718B2Location based audio filtering
Publication Date: 2018.07.24 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10031718B2 patent drawing
  • US10031718B2 patent drawing
  • US10031718B2 patent drawing

AI summary

Methods and systems for augmenting an audio signal are provided for herein. In some embodiments, a method can be performed by a sound processing system of a computing device. In such embodiments, the sound processing system can receive a captured audio signal from a microphone coupled with the sound processing system. The sound processing system can then produce an augmented audio signal by selectively filtering the captured audio signal based on a physical location of the computing device. This resulting augmented audio signal can reflect an effect associated with the physical location of the computing device. The augmented audio signal can then be output, by the sound processing system, to a speaker coupled with the computing device to enable consumption of the augmented audio signal by a user of the computing device. Other embodiments may be described and/or claimed herein.