Adaptive Modulation Filtering for Reverberant Audio Spectral Features

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Audio processing applications, such as speech recognition and speaker identification, face challenges in robustness against acoustic distortion and reverberation, particularly in portable devices where existing methods like spectral subtraction are inefficient.

Innovation Solution

Adaptive modulation filtering is employed to enhance audio spectral features by using observed modulation envelope autocorrelation coefficients, allowing for real-time adaptation to changing acoustic conditions without explicit estimation of SNR or reverberation, and providing filtered spectral features for improved algorithm performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If complex audio processing algorithms (such as spectral subtraction or mapping methods) are used to enhance spectral features, then measurement precision is improved, but device complexity increases making them unsuitable for portable devices

Engineering Contradiction:
Improvespectral feature enhancement accuracyVSAvoidalgorithm complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the essential modulation envelope information from the audio signal and applies filtering only to this extracted component, rather than processing the entire spectral feature set. This selective extraction approach maintains enhancement accuracy while significantly reducing computational complexity for portable devices

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent employs computationally efficient filtering operations that can be quickly applied and discarded, replacing complex, resource-intensive algorithms. The simple filtering approach consumes minimal processing resources while achieving the necessary spectral feature enhancement for portable device operation

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

2Reliability

If complex audio processing algorithms are used to achieve robustness against acoustic distortion, then reliability is improved, but device complexity increases

Engineering Contradiction:
Improverobustness to acoustic distortionVSAvoidalgorithm complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The modulation envelope inherently contains robustness information about the audio signal's temporal structure. By filtering this self-contained envelope information, the system achieves acoustic distortion robustness without requiring external reference signals or complex adaptive algorithms, thereby reducing device complexity

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent changes the processing parameter from full spectral features to specifically the modulation envelope parameters. This parameter transformation maintains reliability against acoustic distortion by preserving temporal modulation characteristics while simplifying the processing requirements for portable devices

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If explicit estimation of acoustic conditions is performed, then adaptability is improved, but computation time increases

Engineering Contradiction:
Improveadaptation to changing acoustic conditionsVSAvoidcomputation time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The modulation envelope automatically adapts to changing acoustic conditions by reflecting the inherent temporal structure of the audio signal. The filtering process follows the envelope's natural variations without requiring explicit estimation or control algorithms, thereby achieving adaptability with minimal computation time for portable devices

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The filtering operation uses the modulation envelope as implicit feedback about acoustic conditions. The envelope's temporal variations provide real-time information about changing acoustic environments, allowing the system to adapt automatically without explicit estimation computations

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9520138B2Adaptive modulation filtering for spectral feature enhancement
Publication Date: 2016.12.13 AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LTD
  • US9520138B2 patent drawing
  • US9520138B2 patent drawing
  • US9520138B2 patent drawing

AI summary

Techniques described herein are directed to the enhancement of spectral features of an audio signal via adaptive modulation filtering. The adaptive modulation filtering process is based on observed modulation envelope autocorrelation coefficients obtained from the audio signal. The modulation envelope autocorrelation coefficients are used to determine parameters of an adaptive filter configured to filter the spectral features of the audio signal to provide filtered spectral features. The parameters are updated based on the observed modulation envelope autocorrelation coefficients to adapt to changing acoustic conditions, such as signal-to-noise ratio (SNR) or reverberation time. Accordingly, such acoustic conditions are not required to be estimated explicitly. Techniques described herein also allow for the estimation of useful side information, e.g., signal-to-noise ratios, based on the observed spectral features of the audio signal and the filtered spectral features, which can be used to improve speaker identification algorithms and/or other audio processing algorithms.