Wearable Headset Audio Spatialization via Head Position Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing audio systems in virtual reality and mixed reality environments fail to provide a realistic and immersive audio experience by not accounting for the user's surroundings or dynamic head movements, leading to inconsistencies that can cause disorientation and discomfort.

Innovation Solution

A wearable head device with sensors determines the user's head position and movement, allowing for the dynamic adjustment of audio signals to simulate the natural behavior of sounds in the environment, presenting them as if originating from specific locations relative to the user's head position and orientation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional audio systems are used in virtual environments, then device complexity is reduced, but audio realism and immersion deteriorate due to inability to account for user surroundings and dynamic head movements

Engineering Contradiction:
Improveaudio realismVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The audio system dynamically adjusts audio signal characteristics based on real-time head position and movement data from sensors. The audio origin and spatial properties are continuously updated to match the user's changing perspective, creating a dynamic audio environment that responds to user actions rather than remaining static

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

Sensors act as intermediaries between the user's physical movements and the audio rendering system. The sensors capture head position and orientation data, which is then processed to determine appropriate audio signal modifications, serving as a bridge that translates physical actions into corresponding audio changes

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If audio signals are dynamically adjusted based on head position, then audio immersion is improved, but processing time and computational requirements increase

Engineering Contradiction:
Improveaudio immersionVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system pre-determines audio origins and spatial properties based on predicted head positions and movements. By anticipating where the user's head will move and pre-calculating the corresponding audio adjustments, the system reduces real-time processing requirements while maintaining the illusion of dynamic audio response

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If static spatialization is used, then device complexity is minimized, but user engagement and realism deteriorate due to lack of dynamic response to head movements

Engineering Contradiction:
Improvesystem simplicityVSAvoiduser engagement
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The audio system implements feedback by continuously monitoring head position and movement through sensors, then using this information to adjust audio signal characteristics. This closed-loop system ensures that audio output consistently reflects the user's physical actions, creating an engaging and responsive experience

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11477599B2Delayed audio following
Publication Date: 2022.10.18 MAGIC LEAP INC
  • US11477599B2 patent drawing
  • US11477599B2 patent drawing
  • US11477599B2 patent drawing

AI summary

Disclosed herein are systems and methods for presenting mixed reality audio. In an example method, audio is presented to a user of a wearable head device. A first position of the user's head at a first time is determined based on one or more sensors of the wearable head device. A second position of the user's head at a second time later than the first time is determined based on the one or more sensors. An audio signal is determined based on a difference between the first position and the second position. The audio signal is presented to the user via a speaker of the wearable head device. Determining the audio signal comprises determining an origin of the audio signal in a virtual environment. Presenting the audio signal to the user comprises presenting the audio signal as if originating from the determined origin. Determining the origin of the audio signal comprises applying an offset to a position of the user's head.