Binaural Rendering With Signal-Dependent Late Reverb Scaling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for processing audio signals based on room impulse responses fail to accurately separate and process early parts and late reverberation, leading to deviations from the results obtained through full-convolution approaches, and do not adequately preserve the influence of the input audio signal on reverberation levels.

Innovation Solution

A method that separately processes audio signals with an early part and late reverberation of the room impulse response, generating a scaled reverberated signal dependent on the audio signal, and combines it with the processed early part to achieve a result perceptually identical to full-convolution, using signal-dependent scaling based on input channel conditions and correlation measures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If full-convolution approach is used to process audio signal with room impulse response, then processing accuracy is improved, but computational complexity increases

Engineering Contradiction:
Improveprocessing accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the room impulse response into two distinct segments: early part (direct sound and early reflections) and late reverberation. This segmentation allows each part to be processed using different methods optimized for their specific characteristics, achieving full-convolution accuracy for the early part while using computationally efficient scaling for the late reverberation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces signal-dependent scaling parameters for the late reverberation that are derived from the input audio signal characteristics. By dynamically adjusting the reverberation level based on signal parameters rather than using fixed full-convolution processing, the system maintains perceptual accuracy while reducing computational complexity.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If conventional methods process audio signal with room impulse response, then computational resources are saved, but accuracy of separating early part and late reverberation deteriorates

Engineering Contradiction:
Improvecomputational efficiencyVSAvoidseparation accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent explicitly segments the impulse response at a transition point between early part and late reverberation. This segmentation enables the system to apply simple scaling to the late reverberation portion while maintaining accurate processing of the early part, achieving both computational efficiency and separation accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different processing qualities to different portions of the impulse response: full-convolution processing is applied locally to the early part where accuracy is critical, while simplified scaling is applied locally to the late reverberation where computational efficiency is more important. This local differentiation resolves the contradiction between efficiency and accuracy.

Inventive Principle:
Principle #3Local quality

3Ease of operation

If artificial late reverberation is generated without signal-dependent scaling, then processing simplicity is improved, but sound quality deteriorates

Engineering Contradiction:
Improveprocessing simplicityVSAvoidsound quality
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The patent introduces signal-dependent scaling parameters that are calculated from the input audio signal characteristics (such as correlation measures and channel conditions). This parameter adaptation maintains processing simplicity while significantly improving sound quality by ensuring the reverberation level appropriately reflects the characteristics of the input signal.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system uses feedback from the input signal characteristics to dynamically adjust the reverberation scaling. By calculating correlation measures and other signal parameters, the system automatically adapts the reverberation level to match the input signal properties, improving sound quality without complicating the overall processing framework.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11445323B2Method for processing an audio signal, signal processing unit, binaural renderer, audio encoder and audio decoder
Publication Date: 2022.09.13 FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
  • US11445323B2 patent drawing
  • US11445323B2 patent drawing
  • US11445323B2 patent drawing

AI summary

A method for processing an audio signal in accordance with a room impulse response is described. The audio signal is processed with an early part of the room impulse response separate from a late reverberation of the room impulse response, wherein the processing of the late reverberation has generating a scaled reverberated signal, the scaling being dependent on the audio signal. The processed early part of the audio signal and the scaled reverberated signal are combined.