AR Sound Localization via Virtual Object Positioning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The presentation of information using sounds has been underexplored in Augmented Reality (AR) technology, where localization information of sounds related to virtual objects is not effectively generated based on their positions.

Innovation Solution

An information processing device and method that generates localization information for sound markers based on the virtual position of virtual objects, determined by the position of real objects in a space, allowing for the output of sounds associated with these markers, enhancing user experience by providing directional audio cues.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If sound localization information is generated based on virtual object position in AR, then user awareness of surrounding information is improved, but the complexity of the information processing system increases

Engineering Contradiction:
Improveuser awareness of surrounding informationVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent combines visual marker position detection with sound localization information generation into a unified processing flow. The sound localization unit integrates with the visual processing chain, using the same virtual position data to generate both visual and auditory output, thereby reducing overall system complexity while improving information delivery

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces a sound localization information generation unit as an intermediary component that translates virtual object positions into directional sound cues. This mediator bridges the gap between visual AR elements and auditory feedback, enabling enhanced user awareness without requiring direct complex interactions between all system components

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If directional sound output is provided based on face orientation, then user interaction with virtual objects is improved, but the device complexity increases

Engineering Contradiction:
Improveuser interactionVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The face orientation detection unit serves multiple functions: it determines user attention direction for selecting virtual objects, provides spatial context for sound localization, and enables natural interaction without additional input devices. This multi-functionality reduces the need for separate interaction mechanisms, thereby improving ease of operation without proportionally increasing device complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses the user's own face orientation as the interaction interface, eliminating the need for separate control devices or complex input mechanisms. The user's natural head movements directly control sound direction and object selection, making the system self-serve the interaction needs without adding external complexity

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS9898863B2Information processing device, information processing method, and program
Publication Date: 2018.02.20 SONY GROUP CORP
  • US9898863B2 patent drawing
  • US9898863B2 patent drawing
  • US9898863B2 patent drawing

AI summary

Provided is an information processing apparatus including a sound output control unit configured to generate localization information of a sound marker based on a virtual position, and a sound output unit configured to output a sound associated with the sound marker, based on the localization information, wherein the virtual position is determined based on a position of a real object present in a space.