3D Sound Localization in Virtual Environments

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies fail to provide precise sound source positioning in virtual environments, as most computers and game consoles are stationary, and stereo headphones do not adapt sound based on user rotation, limiting the effectiveness of 3D sound experiences.

Innovation Solution

A method using sound engines that calculate sound levels and time delays for each ear, incorporating head orientation and directivity, to simulate natural sound localization, allowing users to determine sound sources through binaural hearing, even without visual cues.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If stereo headphones are used with stationary computers and game consoles, then the system is simple and easy to operate, but the sound source positioning precision is poor and does not adapt to user rotation

Engineering Contradiction:
Improvesound source positioning precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent implements dynamic sound field adjustment by continuously tracking head orientation using orientation sensors and recalculating sound parameters in real-time. The sound engine adapts the virtual sound field based on detected head movements, transforming the static stereo system into a dynamic binaural system that maintains accurate sound source positioning regardless of user rotation.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent introduces orientation sensors as an intermediary component between the user's head and the sound engine. These sensors detect head orientation and transmit this information to the sound engine, which then adjusts sound parameters accordingly. This intermediary mechanism enables precise sound source localization without requiring complex hardware modifications to the audio output system.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If 3D sound calculation incorporating head orientation and directivity is implemented, then sound source localization accuracy is improved, but the computational complexity and processing requirements increase

Engineering Contradiction:
Improvesound source localization accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies pre-calculated head-related transfer functions (HRTFs) that are prepared in advance for different head orientations and sound source positions. Instead of performing complex real-time calculations for every sound parameter, the system selects from pre-computed HRTF sets based on current head orientation, significantly reducing computational load while maintaining high localization accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent optimizes computational complexity by changing the representation parameters of sound fields. Instead of calculating complete wave propagation models, the system uses simplified parametric representations of HRTFs that capture the essential acoustic characteristics. This parameter transformation approach maintains localization precision while reducing the computational burden on the sound engine.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables users to intuitively localize sound sources in virtual spaces, enhancing immersive experiences in applications like gaming and music, and providing orientation in real and virtual environments, especially beneficial for blind or visually impaired individuals.

Implementation Method 1

features of sound propagation in the space and user's head

Methodology Applied
Scientific EffectSound propagation: Sound

Implementation Method 2

time delay of the sound arrival to each ear

Methodology Applied
Scientific EffectTime delay of sound arrival: Time of Flight

Implementation Method 3

sound diffraction, and taking into account the sound spectral component

Methodology Applied
Scientific EffectSound diffraction: Diffraction

Implementation Method 4

head-related transfer function

Methodology Applied
Scientific EffectHead-related transfer function:

Data Source

PatentUS11039264B2Method of providing to user 3D sound in virtual environment
Publication Date: 2021.06.15 LATYPOV RAY
  • US11039264B2 patent drawing
  • US11039264B2 patent drawing
  • US11039264B2 patent drawing

AI summary

The invention provides the following items: A method of interactive providing a music composition to user; A method of using 3D sound for orientation of a user on the remote target; A method of providing a computer game to play blindfold; The method of providing to a user the interactive applications with unlimited locomotion. The inventions are based on ability of human binaural hearing and possibility to provide 3D sound to headphones to user from objects in virtual space. User is immersing into virtual space represented by sound objects. Using the user position and orientation in virtual space and position of every sound objects in virtual space, it is possible calculate and provide to a left and a right user's ears 3D sound using Head-Related Transfer Function. With such 3D sound user is able to localize the sound source position and interact with the sound object even blindfold.