Wavefront Synthesis Filter Reverberation Simulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing wavefront synthesis systems fail to accurately reproduce the sense of distance and reverberation, as they do not physically replicate the influences of sound reflections, making it difficult for listeners to perceive the distance to the sound source and the sense of reverberation, even when virtual sound sources are accurately arranged.

Innovation Solution

A signal processing device and method that generates a reverberation sound signal based on the position of a virtual sound source and a reference point, using wavefront synthesis filtering to create a drive signal for a speaker array, which convolves the reverberation sound signal with the virtual sound source signal to simulate realistic reverberation, adjusting the level and length of reverberation according to the distance between the sound source and the listener.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If wavefront synthesis filtering is used to accurately position virtual sound sources, then spatial accuracy is improved, but the sense of distance and reverberation cannot be perceived

Engineering Contradiction:
Improvesound source position accuracyVSAvoidreverberation information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent segments the audio signal processing into two distinct components: direct sound (handled by wavefront synthesis filtering for accurate positioning) and reverberation sound (handled by separate impulse response processing). This segmentation allows each component to be optimized independently - direct sound for spatial accuracy and reverberation for environmental perception - resolving the contradiction between position accuracy and reverberation perception.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary processing stage where reverberation impulse responses are generated based on distance information, and these are then combined with the direct sound signal. This intermediary reverberation processing acts as a mediator that adds the missing environmental information without interfering with the accurate spatial positioning achieved by wavefront synthesis.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If reverberation is added to simulate sound reflections, then the sense of distance and reverberation is improved, but the positioning accuracy of the virtual sound source may be compromised

Engineering Contradiction:
Improvereverberation perceptionVSAvoidsound source position accuracy
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The patent separates the processing of direct sound and reverberation sound into independent pathways. The direct sound signal undergoes wavefront synthesis filtering for accurate positioning, while the reverberation is generated separately using distance-based impulse responses. By keeping these pathways segmented and then combining them, the patent achieves both accurate positioning and realistic reverberation perception without mutual interference.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different processing qualities to different components of the sound signal. The direct sound component receives high-precision wavefront synthesis filtering for accurate localization, while the reverberation component receives processing optimized for environmental simulation. This local differentiation of processing quality allows each component to fulfill its specific function optimally.

Inventive Principle:
Principle #3Local quality

3Adaptability or versatility

If complex reverberation processing is applied to simulate realistic sound environments, then the immersive experience is improved, but the processing time and computational complexity increase

Engineering Contradiction:
Improvereverberation realismVSAvoidprocessing time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent performs preliminary action by pre-calculating or pre-storing reverberation impulse responses for different distance ranges. During real-time processing, the system only needs to select and apply the appropriate pre-computed impulse response based on the current distance, rather than computing complex reverberation in real-time. This preliminary preparation significantly reduces processing time while maintaining reverberation realism.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent changes the processing approach by using distance-based parameter selection. Instead of applying fixed complex reverberation processing, the system adjusts the reverberation characteristics (impulse response selection, mixing ratios) based on the distance parameter between sound source and listener. This parameter-driven approach enables realistic reverberation adaptation with efficient computation.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for the addition of appropriate reverberation that enhances the realistic feeling of the sound field, providing a more immersive experience by accurately simulating the sense of distance and reverberation, even when the listener or sound source moves, and can be implemented in real-time or offline.

Implementation Method 1

Sound heard in a general environment such as a room is reverberated by a sound wave generated from a sound source being repeatedly reflected on a floor, a ceiling, or a wall.

Methodology Applied
Scientific EffectSound wave reflection: Reflection

Implementation Method 2

a signal obtained by performing wavefront synthesis filtering processing on a signal obtained by convolving the reverberation sound signal with a signal of the virtual sound source

Methodology Applied
Scientific EffectConvection: Convection

Data Source

PatentUS12035128B2Signal processing device and signal processing method
Publication Date: 2024.07.09 SONY GROUP CORP
  • US12035128B2 patent drawing
  • US12035128B2 patent drawing
  • US12035128B2 patent drawing

AI summary

Provided is a signal processing device including: a reverberation sound signal generation unit that generates a reverberation sound signal according to a sound source position of a virtual sound source and a distance to a reference point; and a drive signal generation unit that generates a drive signal for a speaker array by a wavefront synthesis filter, in which the drive signal generation unit generates the drive signal on the basis of a signal obtained by performing wavefront synthesis filtering processing on a signal obtained by convolving the reverberation sound signal with a signal of the virtual sound source and/or a signal obtained by performing wavefront synthesis filtering processing on the reverberation sound signal to make the reverberation sound signal into a virtual sound source.