Dynamic Acoustic Image Localization for Immersive Spatial Audio

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies for providing sound localization in augmented reality are limited to fixed object positions, preventing the creation of immersive experiences similar to those in real spaces, as they do not account for moving objects or dynamic user interactions.

Innovation Solution

An information processing apparatus and method that acquires terminal position information and associates it with acoustic-image localization position information to generate and output acoustic-image localization information, allowing for dynamic sound localization based on the user's position within a predetermined area.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If audio data is processed based solely on user information with fixed object positions, then processing simplicity is maintained, but the ability to provide immersive experiences equivalent to real space is lost

Engineering Contradiction:
Improveability to provide immersive experiencesVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies dynamics by transitioning from fixed object positions to dynamic position tracking. The system now processes audio data based on both user information and object movement information, allowing acoustic images to move dynamically with actual objects while maintaining spatial relationships. This resolves the contradiction by enabling immersive experiences through dynamic adaptation without excessive complexity increase.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements feedback mechanisms by continuously acquiring user position information and object position information, then using this feedback to adjust audio output in real-time. The acoustic image position is dynamically adjusted based on the relative positions of user and object, creating an immersive experience that adapts to changing spatial relationships.

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If object positions are kept fixed for audio processing, then system simplicity is maintained, but virtual accompaniment services with moving objects cannot be provided

Engineering Contradiction:
Improveservice diversityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent enables service diversity by allowing objects to move dynamically within the audio space. The system processes audio data based on object movement information, allowing virtual characters and objects to accompany users through different locations while maintaining realistic spatial audio relationships. This enables diverse services like virtual companionship and guided tours with moving objects.

Inventive Principle:
Principle #15Dynamics

3Reliability

If acoustic images are localized at fixed positions, then audio processing is straightforward, but realistic spatial experience equivalent to real space is not achieved

Engineering Contradiction:
Improvespatial accuracyVSAvoidprocessing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system achieves high spatial accuracy by continuously acquiring feedback on user position and object position, then adjusting acoustic image localization accordingly. The acoustic image position is calculated based on the relative spatial relationship between user and object, ensuring that audio always appears to come from the correct direction and distance, matching real-world spatial perception.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent implements dynamic acoustic image localization that updates in real-time as user and object positions change. Instead of fixed positions, the system continuously recalculates acoustic image locations based on current spatial relationships, maintaining high spatial accuracy throughout user movement and object movement while providing a realistic spatial experience.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS12089029B2Information processing apparatus, control method, and non-transitory computer readable medium
Publication Date: 2024.09.10 NEC CORP
  • US12089029B2 patent drawing
  • US12089029B2 patent drawing
  • US12089029B2 patent drawing

AI summary

An information processing apparatus, a control method, and a control program capable of providing an experience close to one experienced in a real space to a user are provided. An information processing apparatus includes: an acquisition unit configured to acquire terminal position information of a communication terminal; a holding unit configured to hold a predetermined area and acoustic-image localization position information of an audio content to be output to the communication terminal while associating them with each other; a generation unit configured to generate acoustic-image localization information based on the acoustic-image localization position information and the terminal position information when the terminal position information is included in the predetermined area; and an output unit configured to output the acoustic-image localization information.