Inter-channel Bandwidth Extension Audio Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing audio encoding technologies face challenges in efficiently encoding multiple audio signals captured by multiple microphones, particularly in stereo encoding, due to temporal and phase mismatches between channels, which affect coding gains and redundancy, leading to reduced efficiency in mid-side and parametric stereo coding techniques.

Innovation Solution

The proposed solution involves determining a temporal shift value between audio channels to align them, generating mid and side channels based on this shift, and omitting the extraction and transmission of inter-channel bandwidth extension (ICBWE) gain mapping parameters to reduce coding complexity and redundancy, allowing the decoder to generate these parameters based on other stereo parameters.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If mid-side and parametric stereo coding techniques are used for stereo encoding, then coding efficiency is improved, but temporal and phase mismatches between channels cause reduced reliability in coding gains and redundancy

Engineering Contradiction:
Improvecoding efficiencyVSAvoidcoding gains and redundancy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent applies preliminary action by performing temporal alignment and phase correction on audio channels before the stereo encoding process. The encoder determines temporal shift values and applies corrections to align left and right channels, ensuring that coding gains and redundancy are calculated based on properly synchronized signals. This preliminary synchronization resolves the contradiction by eliminating temporal mismatches that would otherwise compromise the reliability of coding parameters while maintaining the efficiency benefits of mid-side and parametric stereo coding.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If ICBWE gain mapping parameters are extracted and transmitted in the bitstream, then audio quality is maintained, but coding complexity and transmission bandwidth increase

Engineering Contradiction:
Improveaudio qualityVSAvoidcoding complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies the taking out principle by removing the ICBWE gain mapping parameters from the extraction and transmission process. Instead of extracting these parameters from the frequency-domain channels and including them in the bitstream, the encoder omits this step entirely. The decoder then generates the necessary gain mapping parameters independently using the received stereo parameters (such as inter-channel level differences and phase differences). This approach maintains audio quality by preserving the essential stereo information while significantly reducing coding complexity and transmission bandwidth requirements.

Inventive Principle:
Principle #2Taking out (Extraction)

3Measurement precision

If ICBWE gain mapping parameters are extracted and transmitted, then decoder can reconstruct high-band channels accurately, but transmission bandwidth increases

Engineering Contradiction:
Improvereconstruction accuracyVSAvoidtransmission bandwidth
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent applies the copying principle by having the decoder generate ICBWE gain mapping parameters as a copy or derivation of the received stereo parameters rather than receiving them directly. The decoder uses the transmitted inter-channel level differences and phase differences to reconstruct the gain mapping parameters locally. This approach achieves reconstruction accuracy comparable to direct transmission while reducing transmission bandwidth, as the decoder recreates the necessary parameters from the essential stereo cues already present in the compressed bitstream.

Inventive Principle:
Principle #26Copying

Data Source

PatentEP3607549B1Inter-channel bandwidth extension
Publication Date: 2022.09.28 QUALCOMM INC
  • EP3607549B1 patent drawingFigure 1
  • EP3607549B1 patent drawingFigure 2
  • EP3607549B1 patent drawingFigure 3

AI summary

A method includes decoding a low-band mid channel bitstream to generate a low-band mid signal and a low-band mid excitation signal. The method further includes decoding a high-band mid channel bandwidth extension bitstream to generate a synthesized high-band mid signal. The method also includes determining an inter-channel bandwidth extension (ICBWE) gain mapping parameter corresponding to the synthesized high-band mid signal. The ICBWE gain mapping parameter is based on a selected frequency-domain gain parameter that is extracted from a stereo downmix/upmix parameter bitstream. The method further includes performing a gain scaling operation on the synthesized high-band mid signal based on the ICBWE gain mapping parameter to generate a reference high-band channel and a target high-band channel. The method includes outputting a first audio channel and a second audio channel. The first audio channel is based on the reference high-band channel, and the second audio channel is based on target high-band channel.