Binaural Multi-Channel Decoding With HRTF Energy Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for binaural decoding of multi-channel audio signals, particularly those using HRTF filtering, face challenges in energy conservation and spectral coloring due to non-energy-conserving upmixing rules, especially when dealing with downmixed signals and predictive parameters.

Innovation Solution

A multi-channel decoder is developed that calculates a gain factor to correct energy errors in binaural signal generation by using upmix rule information and HRTF filter characteristics, allowing for energy-corrected binaural signal production without fully rendering multichannel signals, thereby reducing spectral coloring artifacts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If non-energy-conserving upmixing rules are used for binaural decoding, then computational efficiency is improved and audio quality is enhanced, but energy errors occur and spectral coloring artifacts are introduced

Engineering Contradiction:
Improvecomputational efficiencyVSAvoidenergy error
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The patent segments the binaural decoding process into distinct stages: downmixing, upmixing with predictive parameters, and HRTF filtering. By separating these operations, the system can apply non-energy-conserving upmixing rules selectively while managing energy errors through targeted compensation mechanisms rather than processing the entire signal chain uniformly.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent modifies the upmixing parameters (predictive parameters) to optimize the balance between computational efficiency and energy conservation. By adjusting these parameters dynamically, the system achieves improved audio quality and computational performance while mitigating energy errors through parameter optimization rather than fixed processing rules.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If non-energy-conserving upmixing rules are used for binaural decoding, then computational efficiency is improved and audio quality is enhanced, but spectral coloring artifacts are introduced

Engineering Contradiction:
Improvecomputational efficiencyVSAvoidspectral coloring artifact
Core Design Contradiction:
ProductivityVSObject-generated harmful factors

Solution Approach 1:

The patent applies preliminary anti-action by introducing compensation mechanisms before the HRTF filtering stage to counteract the spectral coloring artifacts that will be introduced by non-energy-conserving upmixing. This preventive approach addresses spectral distortions proactively rather than attempting to correct them after they manifest in the final output.

Inventive Principle:
Principle #9Preliminary anti-action

Solution Approach 2:

The patent converts the harmful spectral coloring artifacts into beneficial effects by using the predictive parameters and energy error information to enhance the upmixing process. The previously harmful energy errors are transformed into useful data for optimizing the binaural decoding, improving audio quality while maintaining computational efficiency.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

3Measurement precision

If predictive parameters are used for upmixing, then waveform matching is improved, but energy distribution accuracy deteriorates

Engineering Contradiction:
Improvewaveform matching accuracyVSAvoidenergy distribution accuracy
Core Design Contradiction:
Measurement precisionVSLoss of energy

Solution Approach 1:

The patent applies local quality by optimizing different aspects of the upmixing process separately: predictive parameters are tuned specifically for waveform matching accuracy in certain frequency ranges, while energy distribution is managed through separate compensation mechanisms. This localized optimization allows each parameter set to excel at its specific function without compromising the other.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent introduces dynamics by making the upmixing process adaptive rather than static. Predictive parameters and energy compensation factors are adjusted dynamically based on the input signal characteristics, allowing the system to maintain high waveform matching accuracy while preserving energy distribution accuracy across varying audio content.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10469972B2Binaural multi-channel decoder in the context of non-energy-conserving upmix rules
Publication Date: 2019.11.05 DOLBY INTERNATIONAL AB
  • US10469972B2 patent drawing
  • US10469972B2 patent drawing
  • US10469972B2 patent drawing

AI summary

A multi-channel decoder for generating a binaural signal from a downmix signal using upmix rule information on an energy-error introducing upmix rule for calculating a gain factor based on the upmix rule information and characteristics of head related transfer function based filters corresponding to upmix channels. The one or more gain factors are used by a filter processor for filtering the downmix signal so that an energy corrected binaural signal having a left binaural channel and a right binaural channel is obtained.