Binaural Renderer Using Correlation-Scaled Late Reverberation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for processing audio signals based on room impulse responses fail to accurately separate and process early reflections and late reverberation, leading to deviations from the results obtained through full-convolution approaches, and often require complex hearing models or extensive calculations.

Innovation Solution

A method that separately processes audio signals with early and late reverberation components of the room impulse response, using a scaled reverberated signal generated by applying a gain factor based on empirical correlation measures or channel conditions, allowing for a more efficient and accurate simulation of full-convolution results without the need for extensive calculations or hearing models.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If full-convolution approach is used to process audio signal with room impulse response, then accuracy of reverberation simulation is improved, but computational complexity increases

Engineering Contradiction:
Improveaccuracy of reverberation simulationVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The room impulse response is segmented into early reflections and late reverberation components. The method processes these two components separately, applying different techniques to each: early reflections are processed with convolution for accuracy, while late reverberation is processed with simplified scaling based on correlation measures, reducing overall computational complexity while maintaining perceptual accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The invention changes the processing parameters from full-convolution to a hybrid approach using correlation-based scaling for late reverberation. By analyzing the correlation measure of the audio signal and applying appropriate gain factors, the method achieves comparable perceptual results with reduced computational effort.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If hearing models are used to scale late reverberation, then perceptual accuracy is improved, but device complexity increases

Engineering Contradiction:
Improveperceptual accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Instead of using complex, computationally expensive hearing models, the invention employs simpler correlation-based measures that are easier to calculate. The method uses gain factors derived from correlation analysis of the audio signal, which provides sufficient perceptual accuracy without the overhead of implementing full hearing models.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

3Productivity

If separate processing of early reflections and late reverberation is implemented, then processing efficiency is improved, but accuracy may deteriorate

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidaccuracy of reverberation simulation
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The method applies different processing qualities to different parts of the reverberation: early reflections receive full convolution processing for high accuracy, while late reverberation receives simplified scaling processing. This local differentiation of processing quality maintains overall accuracy while improving efficiency, as each component is processed according to its specific requirements.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9955282B2Method for processing an audio signal, signal processing unit, binaural renderer, audio encoder and audio decoder
Publication Date: 2018.04.24 FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
  • US9955282B2 patent drawing
  • US9955282B2 patent drawing
  • US9955282B2 patent drawing

AI summary

A method for processing an audio signal in accordance with a room impulse response is described. The audio signal is processed with an early part of the room impulse response separate from a late reverberation of the room impulse response, wherein the processing of the late reverberation has generating a scaled reverberated signal, the scaling being dependent on the audio signal. The processed early part of the audio signal and the scaled reverberated signal are combined.