Binaural Room Impulse Response Filter for Spatial Audio

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing spatial audio reproduction systems struggle to accurately simulate reverberation in small rooms, often resulting in low frequency resonances, slap echoes, poor diffusion, and an unfavorable direct to reverberant ratio, which detract from the immersive audio experience.

Innovation Solution

A binaural room impulse response (BRIR) filter is generated based on the user's head position and a set of head-related impulse responses (HRIRs), continuously updated to reflect changes in head position, which creates a realistic reverberation effect by simulating reflections with specific directions, delays, and frequency-dependent absorption, allowing for flexible control over the reflection pattern to avoid undesirable room characteristics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional spatial audio reproduction systems simulate reverberation in small rooms, then the audio experience becomes more immersive, but low frequency resonances and slap echoes occur

Engineering Contradiction:
Improveimmersive audio experienceVSAvoidlow frequency resonances and slap echoes
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent segments the reverberation simulation into multiple discrete acoustic reflections, each with specific direction, delay, and frequency-dependent absorption characteristics. Instead of using a traditional room impulse response that captures all room acoustics including harmful resonances, the invention divides the reverberation into individual reflection components that can be selectively controlled and positioned in the binaural audio field.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by assigning different frequency-dependent absorption characteristics to different acoustic reflections. Each reflection can have tailored absorption properties that match the specific reflecting surface material and orientation, allowing realistic reverberation simulation while avoiding the uniform harmful resonances that affect traditional small room acoustics.

Inventive Principle:
Principle #3Local quality

2Device complexity

If traditional spatial audio systems use fixed binaural filters, then the implementation is simpler, but the spatial accuracy deteriorates when head position changes

Engineering Contradiction:
Improvefilter implementation simplicityVSAvoidspatial accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent implements dynamic binaural filters that automatically update based on detected head position changes. The system continuously monitors head orientation and adjusts the binaural room impulse responses accordingly, maintaining accurate spatial audio reproduction across different head positions without requiring complex manual reconfiguration.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system incorporates feedback mechanisms that detect head position and use this information to adaptively adjust the binaural filters. This closed-loop approach ensures that the spatial audio rendering remains accurate by continuously aligning the filter characteristics with the current head orientation, resolving the contradiction between simplicity and precision.

Inventive Principle:
Principle #23Feedback

3Reliability

If acoustic reflections are added to simulate room reverberation, then the spatial realism is improved, but the direct to reverberant ratio becomes unfavorable

Engineering Contradiction:
Improvespatial realismVSAvoiddirect to reverberant ratio
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent employs parameter changes by controlling the delay, direction, and absorption characteristics of each acoustic reflection. By carefully adjusting these parameters, the system simulates realistic room reverberation while maintaining control over the overall energy balance, ensuring that the direct to reverberant ratio remains appropriate for the intended spatial environment.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach effectively mimics the reverberation of a room, enhancing the spatial audio experience by maintaining the main reverberation characteristics while avoiding issues associated with small room acoustics, such as low frequency resonances and poor diffusion, thereby providing a more believable and immersive audio environment.

Implementation Method 1

Each of the HRIRs are determined for a respective one of a plurality of acoustic reflections such that, when taken together, the acoustic reflections approximate reverberation of a room

Methodology Applied
Scientific EffectAcoustic reflection: Reflection

Implementation Method 2

the acoustic reflections approximate reverberation of a room

Methodology Applied
Scientific EffectReverberation: Reverberation

Implementation Method 3

frequency dependent absorption of the sound by the reflecting surfaces

Methodology Applied
Scientific EffectFrequency-dependent absorption: Acoustic Absorption

Implementation Method 4

The equalizer simulates frequency dependent absorption of the sound by the reflecting surfaces

Methodology Applied
Scientific EffectAcoustic absorption: Acoustic Absorption

Data Source

PatentUS11417347B2Binaural room impulse response for spatial audio reproduction
Publication Date: 2022.08.16 APPLE INC
  • US11417347B2 patent drawing
  • US11417347B2 patent drawing
  • US11417347B2 patent drawing

AI summary

A binaural room impulse response (BRIR) can be generated based on a position of a listener's head, and a plurality of head related impulse responses (HRIRs). Each of the plurality of HRIRs are selected for a respective one of a plurality of acoustic reflections which, when taken together, approximate reverberation of a room. Each of the acoustic reflections have a direction and a delay. The BRIR filter is applied to source audio to generate binaural audio output.