QMF Subband Filtering for Low-Complexity Binaural Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Binaural rendering for multi-channel signals in stereo requires high computational complexity, particularly when using long binaural room impulse response (BRIR) filters, leading to inefficient processing and potential sound quality loss.

Innovation Solution

The method involves using truncated subband filter coefficients based on filter order information and characteristic information from BRIR filter coefficients, allowing for variable length filtering in the QMF domain to reduce computational complexity while maintaining sound quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If long BRIR filters are used for binaural rendering, then sound quality is improved, but computational complexity increases

Engineering Contradiction:
Improvesound qualityVSAvoidcomputational complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent divides the long BRIR filter into multiple subband filters operating in parallel in the frequency domain. Each subband filter processes a specific frequency range, allowing the overall filtering operation to be performed with reduced computational complexity compared to a single long-time-domain filter, while maintaining sound quality through frequency-selective processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transforms the filtering operation from the time domain to the frequency domain using QMF (Quadratic Mirror Filter) transform. This parameter change allows convolution with long BRIR filters to be performed as simple multiplication in the frequency domain, dramatically reducing computational complexity while preserving the acoustic characteristics of the original long-filter processing.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If the number of input channels increases, then channel coverage is improved, but computational complexity increases

Engineering Contradiction:
Improvechannel coverageVSAvoidcomputational complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges multiple channel processing operations into a unified frequency-domain processing framework. By transforming all input channels into the QMF domain simultaneously and applying subband filtering operations that can be shared across channels, the system achieves efficient multi-channel processing that scales better than independent time-domain processing of each channel.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent creates a universal processing framework where the same QMF-based subband filtering architecture handles any number of input channels. The frequency-domain processing operations and subband filter banks serve multiple channels simultaneously, making the system adaptable to different channel configurations (stereo, 5.1, 7.1, etc.) without proportionally increasing computational complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Manufacturing precision

If time-domain convolution is used for binaural filtering, then filtering accuracy is improved, but processing efficiency decreases

Engineering Contradiction:
Improvefiltering accuracyVSAvoidprocessing efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent replaces the mechanical time-domain convolution operation with frequency-domain multiplication using QMF transform. This substitution maintains filtering accuracy because the QMF transform provides a complete representation of the signal, allowing exact convolution through multiplication in the frequency domain, while dramatically improving processing efficiency by avoiding the O(N*M) complexity of time-domain convolution.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11622218B2Method and apparatus for processing multimedia signals
Publication Date: 2023.04.04 WILUS INSTITUTE OF STANDARDS & TECHNOLOGY INC
  • US11622218B2 patent drawing
  • US11622218B2 patent drawing
  • US11622218B2 patent drawing

AI summary

The present invention relates to a method and an apparatus for processing a signal, which are used for effectively reproducing a multimedia signal, and more particularly, to a method and an apparatus for processing a signal, which are used for implementing filtering for multimedia signal having a plurality of subbands with a low calculation amount.To this end, provided are a method for processing a multimedia signal including: receiving a multimedia signal having a plurality of subbands; receiving at least one proto-type filter coefficients for filtering each subband signal of the multimedia signal; converting the proto-type filter coefficients into a plurality of subband filter coefficients; truncating each subband filter coefficients based on filter order information obtained by at least partially using characteristic information extracted from the corresponding subband filter coefficients, the length of at least one truncated subband filter coefficients being different from the length of truncated subband filter coefficients of another subband; and filtering the multimedia signal by using the truncated subband filter coefficients corresponding to each subband signal and an apparatus for processing a multimedia signal using the same.