Acoustic Sound Source Rendering via Dynamic Spherical Harmonic Crossfading

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional surround sound systems face challenges in simulating the precise location of sound sources due to physical constraints and cross-talk issues, and existing methods like spherical harmonic representations are computationally expensive and limited to a small 'sweet spot'.

Innovation Solution

A method that crossfades between point sound source simulation and spherical harmonic representation based on the location and size of the sound source, using Head Related Transfer Functions (HRTF) and Room Transfer Functions, with a system that adjusts volume levels to transition between models as the sound source moves, reducing computational complexity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If spherical harmonic representation is used to simulate sound source location, then measurement precision of sound source location is improved, but device complexity and computational requirements increase significantly

Engineering Contradiction:
Improvesound source location precisionVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the sound field representation into different spherical harmonic orders (e.g., first-order vs. second-order). By using only the necessary order for each sound source scenario, the system achieves adequate localization precision without computing all possible higher-order harmonics, thus reducing computational complexity while maintaining measurement precision.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent dynamically adjusts the spherical harmonic order parameter based on the sound source characteristics and listening position. When a sound source moves or when different precision requirements are detected, the system changes the harmonic order parameter to optimize between computational efficiency and localization accuracy, avoiding unnecessary complex calculations.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If spherical harmonic representation is used to simulate sound source location, then measurement precision of sound source location is improved, but the system is limited to a small 'sweet spot' area

Engineering Contradiction:
Improvesound source location precisionVSAvoidlistening position range
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic adaptation of the spherical harmonic representation based on the listener's position and the sound source's location. As the listener moves outside the traditional sweet spot, the system dynamically adjusts the harmonic decomposition and reconstruction process to maintain accurate sound source localization across a wider spatial range, thereby expanding adaptability while preserving precision.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent extends the spherical harmonic representation from traditional limited spatial configurations to more comprehensive angular and radial distributions. By utilizing higher-order spherical harmonics selectively and implementing position-dependent rendering, the system expands the effective listening area beyond the small sweet spot while maintaining localization precision through enhanced spatial dimensionality.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of operation

If traditional surround sound systems are used, then ease of operation is maintained, but measurement precision of sound source location deteriorates due to physical constraints and cross-talk

Engineering Contradiction:
Improvesystem setup simplicityVSAvoidsound source location precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent replaces the mechanical/physical surround sound speaker arrangement with a computational spherical harmonic-based virtual surround system. This substitution eliminates the need for precise physical speaker placement and cross-talk elimination hardware, while achieving superior sound source location precision through mathematical modeling and signal processing, thus maintaining ease of operation while dramatically improving measurement precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach provides a more efficient and accurate simulation of sound source location and movement, improving the audio experience by reducing computational requirements and maintaining fidelity across different sound source distances and sizes.

Implementation Method 1

Some known audio signal processing techniques use what is known as a Head Related Impulse Response (HRIR) function or Head Related Transfer Function (HRTF) to account for the effect of the user's own head on the sound that reaches the user's ears.

Methodology Applied
Scientific EffectHead Related Transfer Function (HRTF):

Implementation Method 2

Sound localization typically involves convolving the source signal with an HRTF for each ear for the desired source location.

Methodology Applied
Scientific EffectSound localization through convolution:

Implementation Method 3

the acoustic effect of the environment also needs to be taken into account to create a surround sound signal that sounds as if it were naturally being played in some environment

Methodology Applied
Scientific EffectRoom impulse response modeling:

Data Source

PatentUS11388540B2Method for acoustically rendering the size of a sound source
Publication Date: 2022.07.12 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11388540B2 patent drawing
  • US11388540B2 patent drawing
  • US11388540B2 patent drawing

AI summary

Movement of a sound source toward or away from a listener may be simulated by crossfading a sound level of a point sound source signal representation of a source waveform and a spherical harmonic representation of the source waveform as a simulated distance of a listener from a sound source changes to generate a cross-faded waveform. A speaker may be driven with the cross-faded waveform.