Augmented Reality Audio Adaptation via Device Orientation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality systems cannot determine the position of a hand-held device, limiting the enhancement of the user's experience by not adjusting audio content based on the device's location and orientation within an environment.

Innovation Solution

A device with a location processing module and an orientation processing module that modifies audio content based on the device's location and orientation, allowing for enhanced audio output by adjusting sound characteristics such as loudness and direction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If audio content is modified based on device location and orientation, then the user's augmented reality experience is enhanced, but the device complexity increases due to additional location processing and orientation processing modules

Engineering Contradiction:
Improveaudio content adaptabilityVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system is divided into distinct functional modules: a location processing module that handles position determination, an orientation processing module that handles device orientation, and an audio content modification module. This segmentation allows each module to specialize in specific tasks, improving overall system adaptability while managing complexity through modular design.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The device integrates multiple functions into a single system: location determination, orientation determination, and audio content modification all occur within the same device. This multi-functionality enhances the user experience by providing comprehensive augmented reality audio enhancement without requiring multiple separate devices.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If location processing module and orientation processing module are added to determine device position, then audio content modification accuracy is improved, but the device complexity increases

Engineering Contradiction:
Improvelocation and orientation determination accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The determination process is segmented into two independent modules: location processing module for position determination and orientation processing module for orientation determination. This segmentation improves measurement precision by dedicating specialized modules to each task while managing complexity through functional separation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The location processing module and orientation processing module act as intermediary components between the audio content and the modification process. These modules provide accurate position and orientation data that enable precise audio content modification without requiring the audio processing to directly handle complex determination algorithms.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If audio content is modified based on device location and orientation, then the immersive audio experience is enhanced, but the processing time and computational resources increase

Engineering Contradiction:
Improveaudio experience qualityVSAvoidprocessing time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system performs preliminary determination of device location and orientation before audio content modification. By obtaining position and orientation data in advance, the system prepares the necessary parameters for audio modification, reducing real-time processing delays and improving the overall responsiveness of the augmented reality audio experience.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8170222B2Augmented reality enhanced audio
Publication Date: 2012.05.01 SONY GROUP CORP
  • US8170222B2 patent drawing
  • US8170222B2 patent drawing
  • US8170222B2 patent drawing

AI summary

A device and method for providing augmented reality enhanced audio. The device is portable and may include a location processing module capable of receiving location information and determining a location of the device in an environment, an orientation processing module capable of determining an orientation of the device at the location, a processor capable of modifying audio content based on the location of the device in the environment and the orientation of the device at the location, and an audio output device capable of outputting the modified audio content. The orientation of the device includes an azimuth and an elevation of the device.