Personalized Audio Virtualization Using HRTF and Reverberation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional audio reproduction methods fail to convey the spatial attributes of the original content, resulting in an undesirable audio experience for consumers, as they cannot replicate the intent of the content producer.

Innovation Solution

A method and apparatus for personalized audio virtualization, which involves receiving digital audio content and metadata, configuring digital filters based on room and listener hearing profiles, and processing the audio signals to recreate the acoustic properties of a predetermined room, including using head-related transfer function (HRTF) filter coefficients and early and late reverberation parameters.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional audio reproduction methods are used, then the audio signal can be played back through speakers or headphones, but the spatial attributes of the original content cannot be reproduced

Engineering Contradiction:
Improvespatial attribute reproduction accuracyVSAvoidoriginal content spatial information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing head-related transfer function (HRTF) data and room acoustic characteristics before audio playback. The system prepares personalized audio profiles including HRTF coefficients and reverberation parameters in advance, so that when audio content is played back, the spatial transformation can be applied immediately without real-time computation, thus preserving spatial attributes while maintaining playback simplicity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary processing layer that transforms the original audio signal through HRTF convolution and room acoustic simulation before output to the listener. This intermediary process includes applying HRTF filters to simulate sound arriving at the ears from different directions, and adding reverberation effects to recreate the original listening environment, thereby preserving spatial information that would otherwise be lost in traditional playback.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If personalized audio processing with multiple filters and parameters is applied, then spatial attributes and acoustic properties can be reproduced, but the device complexity increases

Engineering Contradiction:
Improveacoustic property reproduction accuracyVSAvoidaudio processing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs complex HRTF calculations, room acoustic measurements, and filter design in advance during a setup or calibration phase. These pre-computed parameters including HRTF coefficients, early reflection patterns, and late reverberation characteristics are stored for reuse during actual audio playback, eliminating the need for real-time complex computations and reducing the processing burden during normal operation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The audio processing system is divided into separate functional modules: HRTF filtering module, early reflection module, late reverberation module, and output mixing module. Each module handles a specific aspect of spatial audio reproduction independently, allowing for easier implementation, debugging, and optimization of each component while maintaining overall system functionality.

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If HRTF filtering and reverberation processing are applied to audio channels, then the acoustic properties of the recording environment can be recreated, but the processing time and computational resources increase

Engineering Contradiction:
Improveroom acoustic property accuracyVSAvoidaudio processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system pre-computes HRTF convolution kernels and room impulse responses before audio playback. These pre-calculated filters capture the spatial and acoustic characteristics of the original recording environment, allowing the system to apply them during playback without performing complex real-time calculations, thus maintaining acoustic accuracy while reducing processing time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Instead of recreating the entire acoustic environment in real-time, the system creates simplified copies or models of the original acoustic space using measured or synthesized impulse responses. These compact representations preserve the essential acoustic properties (reverberation time, frequency response, spatial distribution) while requiring minimal computational resources for application during audio playback.

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution enables a high-quality audio reproduction that accurately conveys the original intent of the content producer by recreating the acoustic properties of the recording environment, providing a more immersive and accurate sonic experience for listeners.

Implementation Method 1

The room measurement profile includes at least a set of head-related transfer function (HRTF) filter coefficients

Methodology Applied
Scientific EffectHead-related transfer function (HRTF):

Implementation Method 2

a late reverberation parameter that configures a parametric model of the late reverberation of the predetermined room

Methodology Applied
Scientific EffectReverberation: Reverberation

Data Source

PatentUS10070245B2Method and apparatus for personalized audio virtualization
Publication Date: 2018.09.04 DTS INC(US)
  • US10070245B2 patent drawing
  • US10070245B2 patent drawing
  • US10070245B2 patent drawing

AI summary

A method and apparatus may be used to perform personalized audio virtualization. The apparatus may include a speaker, a headphone (over-the-ear, on-ear, or in-ear), a microphone, a computer, a mobile device, a home theater receiver, a television, a Blu-ray (BD) player, a compact disc (CD) player, a digital media player, or the like. The apparatus may be configured to receive an audio signal, scale the audio signal, and perform a convolution and reverberation on the scaled audio signal to produce a convolved audio signal. The apparatus may be configured to filter the convolved audio signal and process the filtered audio signal for output.