Variable-Length Subband Filtering for Multi-Channel Binaural Audio

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Binaural rendering for multi-channel signals in stereo requires high computational complexity, especially when using long binaural room impulse response (BRIR) filters, leading to inefficient processing and potential sound quality loss.

Innovation Solution

The method involves using truncated subband filter coefficients based on filter order information and characteristic information from BRIR filter coefficients, allowing for variable length filtering in the QMF domain to reduce computational complexity while maintaining sound quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If long BRIR filters are used for binaural rendering, then sound quality is improved, but computational complexity increases

Engineering Contradiction:
Improvesound qualityVSAvoidcomputational complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent divides the long BRIR filter into multiple subband filters operating in parallel in the frequency domain. Each subband filter processes a specific frequency range, allowing the overall filtering operation to be distributed across multiple shorter filters rather than one extremely long filter, thereby reducing computational complexity while preserving sound quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transforms the time-domain convolution operation into the frequency domain using QMF (Quadrature Mirror Filter) transform. This dimensional change from time domain to frequency domain enables more efficient processing by exploiting the structure of BRIR in the frequency domain, reducing the computational burden of long filter convolutions.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If the number of input channels increases, then channel capacity is improved, but computational complexity increases

Engineering Contradiction:
Improvechannel capacityVSAvoidcomputational complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent processes each input channel through the same set of subband filters in parallel, allowing the system to scale to multiple channels without proportionally increasing complexity. The segmented subband structure enables efficient handling of multi-channel signals by reusing the same filter bank across channels.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The subband filter bank is designed to be universally applicable to any number of input channels. The same filter structure and processing methodology can handle 2-channel, 5.1-channel, or higher configurations without requiring fundamentally different processing approaches, providing scalability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Device complexity

If truncated subband filter coefficients are used, then computational complexity is reduced, but sound quality may deteriorate

Engineering Contradiction:
Improvecomputational complexityVSAvoidsound quality
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent uses truncated versions of the full BRIR filter coefficients for each subband, applying partial action rather than complete filtering. The truncation length is optimized to provide sufficient filtering performance while avoiding the need to process the entire long BRIR, achieving a balance between quality and complexity.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

Different subbands use different truncation lengths for their filter coefficients based on their specific frequency characteristics. Lower frequency subbands may use longer truncations while higher frequency subbands use shorter ones, optimizing the balance between quality and complexity locally for each frequency region rather than applying a uniform approach.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11096000B2Method and apparatus for processing multimedia signals
Publication Date: 2021.08.17 WILUS INSTITUTE OF STANDARDS & TECHNOLOGY INC
  • US11096000B2 patent drawing
  • US11096000B2 patent drawing
  • US11096000B2 patent drawing

AI summary

The present invention relates to a method and an apparatus for processing a signal, which are used for effectively reproducing a multimedia signal, and more particularly, to a method and an apparatus for processing a signal, which are used for implementing filtering for multimedia signal having a plurality of subbands with a low calculation amount.To this end, provided are a method for processing a multimedia signal including: receiving a multimedia signal having a plurality of subbands; receiving at least one proto-type filter coefficients for filtering each subband signal of the multimedia signal; converting the proto-type filter coefficients into a plurality of subband filter coefficients; truncating each subband filter coefficients based on filter order information obtained by at least partially using characteristic information extracted from the corresponding subband filter coefficients, the length of at least one truncated subband filter coefficients being different from the length of truncated subband filter coefficients of another subband; and filtering the multimedia signal by using the truncated subband filter coefficients corresponding to each subband signal and an apparatus for processing a multimedia signal using the same.