Subband Binaural Filtering With Truncated BRIR Convolution

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Binaural rendering for multi-channel signals in stereo requires high computational complexity, especially with long binaural room impulse response (BRIR) filters, leading to inefficient processing and sound quality loss.

Innovation Solution

A method and apparatus for processing audio signals that perform binaural rendering in the QMF domain using truncated BRIR filters, separating filter coefficients into shorter F-part and P-part components for efficient convolution and reverberation processing, reducing computational complexity while maintaining sound quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If long BRIR filters are used for binaural rendering, then sound quality is improved, but computational complexity increases significantly

Engineering Contradiction:
Improvesound qualityVSAvoidcomputational complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent divides the long BRIR filter into multiple short-time filters corresponding to different time segments. Each short-time filter processes a specific time portion of the impulse response, allowing parallel processing and reducing overall computational complexity while maintaining the quality characteristics of the original long filter.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies dynamic filtering where the filter characteristics change over time. By using time-varying short-time filters instead of a static long filter, the system adapts to different temporal characteristics of the audio signal, reducing computational load while preserving sound quality across different time intervals.

Inventive Principle:
Principle #15Dynamics

2Manufacturing precision

If the number of input channels increases (e.g., 22.2 channel format), then audio quality and spatial perception are improved, but computational complexity becomes enormous

Engineering Contradiction:
Improveaudio qualityVSAvoidcomputational complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the multi-channel processing into multiple time-based stages, where each stage processes a subset of channels with short-time filters. This temporal segmentation allows the system to handle high channel counts by distributing computational load across time segments rather than processing all channels simultaneously with full-length filters.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial filtering by using truncated short-time filters that process only the most critical portions of the impulse response. By applying partial action (processing only essential time segments) rather than complete filtering across the entire BRIR length, the system maintains acceptable audio quality while dramatically reducing computational requirements for multi-channel formats.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If binaural filtering is performed in time domain, then processing accuracy is improved, but additional QMF synthesis operations are required for each channel

Engineering Contradiction:
Improveprocessing accuracyVSAvoidprocessing operations
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the filtering operation into short-time filters that can be efficiently applied in the QMF domain. By dividing the time-domain filtering into multiple frequency-domain filtering stages using short-time Fourier transforms, the system maintains processing accuracy while eliminating the need for separate QMF synthesis operations for each channel.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP3767970B1Method and apparatus for processing multimedia signals
Publication Date: 2022.09.28 WILUS INSTITUTE OF STANDARDS & TECHNOLOGY INC
  • EP3767970B1 patent drawingFigure 1
  • EP3767970B1 patent drawingFigure 2
  • EP3767970B1 patent drawingFigure 3

AI summary

The present invention relates to a method and an apparatus for processing a signal, which are used for effectively reproducing a multimedia signal, and more particularly, to a method and an apparatus for processing a signal, which are used for implementing filtering for multimedia signal having a plurality of subbands with a low calculation amount. To this end, provided are a method for processing a multimedia signal including: receiving a multimedia signal having a plurality of subbands; receiving at least one proto-type filter coefficients for filtering each subband signal of the multimedia signal; converting the proto-type filter coefficients into a plurality of subband filter coefficients; truncating each subband filter coefficients based on filter order information obtained by at least partially using characteristic information extracted from the corresponding subband filter coefficients, the length of at least one truncated subband filter coefficients being different from the length of truncated subband filter coefficients of another subband; and filtering the multimedia signal by using the truncated subband filter coefficients corresponding to each subband signal and an apparatus for processing a multimedia signal using the same.