3D Spatial Audio Headphone HRTF Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for maintaining a stable three-dimensional sound field during user head movements in virtual audio environments are computationally expensive and result in impaired distance cues and directional localization accuracy, especially when using non-individualized Head Related Transfer Functions (HRTFs).

Innovation Solution

The method involves encoding audio signals into a sound field format, dynamically rotating the sound field based on user movement data, processing with dynamic audio filters that account for anthropometric auditory cues, and parameterizing room impulse responses into directional and diffuse components to generate decorrelated reverb tail filters, which are then modeled using randomness in acoustic responses.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If existing methods use non-individualized Head Related Transfer Functions (HRTFs) to maintain stable sound field during head movements, then the computational cost is reduced, but the distance cues and directional localization accuracy are impaired

Engineering Contradiction:
Improvecomputational efficiencyVSAvoiddirectional localization accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The sound field is segmented into multiple independent virtual loudspeaker channels (e.g., 3D audio objects or spatial sound sources) that can be individually tracked and processed. Each sound source is represented as a separate entity with its own spatial coordinates, allowing the system to efficiently compute head-related transfer functions only for active sources rather than processing the entire sound field monolithically.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adapts the sound field processing based on detected head movements. When head movement is detected via sensors (accelerometers, gyroscopes), the virtual loudspeaker positions are dynamically updated to maintain stable spatial audio perception. This dynamic adjustment allows the system to maintain localization accuracy only when necessary, reducing computational load during stationary periods.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If existing methods dynamically adjust sound field for head movements, then directional localization is improved, but front-back confusions increase and elevation perception deteriorates

Engineering Contradiction:
Improvedirectional localization accuracyVSAvoidfront-back confusion reduction
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system changes key acoustic parameters including Head-Related Transfer Functions (HRTFs) based on detected head orientation and position. By selecting appropriate HRTF sets that match the current head pose and applying time-varying filters, the system maintains accurate front-back differentiation and elevation cues while adapting to head movements. The parameter changes include adjusting interaural time differences, interaural level differences, and spectral shaping characteristics.

Inventive Principle:
Principle #35Parameter changes

3Stability of the object's composition

If virtual loudspeaker positions are updated during head movements, then sound field stability is maintained, but computational complexity increases

Engineering Contradiction:
Improvesound field stabilityVSAvoidprocessing complexity
Core Design Contradiction:
Stability of the object's compositionVSDevice complexity

Solution Approach 1:

Head-related transfer functions and spatial filtering parameters are pre-computed and stored for various head orientations and virtual loudspeaker positions. When head movement is detected, the system simply retrieves and applies the pre-computed parameters corresponding to the new head pose, rather than computing the entire sound field transformation in real-time. This lookup-based approach maintains sound field stability while significantly reducing processing complexity.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9560467B23D immersive spatial audio systems and methods
Publication Date: 2017.01.31 GOOGLE LLC
  • US9560467B2 patent drawing
  • US9560467B2 patent drawing
  • US9560467B2 patent drawing

AI summary

Provided are methods and systems for delivering three-dimensional, immersive spatial audio to a user over a headphone, where the headphone includes one or more virtual speaker conditions. The methods and systems recreate a naturally sounding sound field at the user's ears, including cues for elevation and depth perception. Among numerous other potential uses and applications, the methods and systems of the present disclosure may be implemented for virtual reality applications.