AR Audio Directional Control via Localized Attenuation Override

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality systems face challenges in rendering virtual and real-world audio effectively, leading to a need for improved audio management to enhance immersion.

Innovation Solution

The system generates or obtains augmented reality images and uses active noise control to attenuate real-world audio, while controlling audio provision in specific focus directions related to selected real-world objects, allowing for the override of attenuation to provide real-world audio, thereby improving the immersive experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If active noise control is used to attenuate real-world audio, then the immersive AR experience is improved, but the user cannot hear relevant real-world audio

Engineering Contradiction:
Improveimmersive AR experienceVSAvoidreal-world audio
Core Design Contradiction:
Ease of manufactureVSLoss of information

Solution Approach 1:

The system applies different audio processing treatments to different spatial directions. Audio attenuation is applied globally, but audio preservation is selectively applied in specific directions where real-world objects are located. This creates a spatially varying audio field where some directions have attenuated audio (for immersion) while others have preserved audio (for awareness of real-world objects).

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The audio field is segmented into multiple directional zones. Each zone corresponds to a different real-world object or direction of interest. The system independently controls audio attenuation and preservation for each segmented direction, allowing simultaneous immersion in AR content while maintaining awareness of specific real-world audio sources in different directions.

Inventive Principle:
Principle #1Segmentation

2Ease of manufacture

If audio attenuation is applied globally, then immersion is enhanced, but directional awareness of real-world objects is lost

Engineering Contradiction:
ImproveimmersionVSAvoiddirectional awareness
Core Design Contradiction:
Ease of manufactureVSEase of operation

Solution Approach 1:

The audio processing system dynamically adjusts attenuation levels based on real-time detection of real-world objects and user interaction. When a user interacts with or directs attention to a real-world object, the system dynamically preserves audio in that direction while maintaining attenuation in other directions. This dynamic adaptation allows the system to switch between immersive and awareness modes as needed.

Inventive Principle:
Principle #15Dynamics

3Ease of operation

If audio preservation is applied in multiple directions, then directional awareness is improved, but immersion is reduced

Engineering Contradiction:
Improvedirectional awarenessVSAvoidimmersion
Core Design Contradiction:
Ease of operationVSEase of manufacture

Solution Approach 1:

The system applies audio preservation locally only in specific directions where real-world objects are detected, rather than globally across all directions. This localized approach maintains immersion in the majority of the audio field while providing directional awareness only where necessary for interaction with real-world objects.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11937071B2Augmented reality system
Publication Date: 2024.03.19 NOKIA TECHNOLOGIES OY
  • US11937071B2 patent drawing
  • US11937071B2 patent drawing
  • US11937071B2 patent drawing

AI summary

A method, apparatus and computer program is described comprising: generating or obtaining at least one augmented reality image for presentation to a user, the augmented reality images comprising one or more virtual objects, displays or devices of an augmented reality system; attenuating real-world audio of the augmented reality system; and controlling the provision of audio to the user in at least one audio focus or beamform direction relating to at least one selected real-world object of the augmented reality system.