Inter-channel Bandwidth Extension Audio Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio encoding technologies face challenges in efficiently encoding multiple audio signals captured by multiple microphones, particularly in stereo encoding, due to temporal and phase mismatches between channels, which affect coding gains and redundancy, leading to reduced efficiency in mid-side and parametric stereo coding techniques.
Innovation Solution
The proposed solution involves determining a temporal shift value between audio channels to align them, generating mid and side channels based on this shift, and omitting the extraction and transmission of inter-channel bandwidth extension (ICBWE) gain mapping parameters to reduce coding complexity and redundancy, allowing the decoder to generate these parameters based on other stereo parameters.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If mid-side and parametric stereo coding techniques are used for stereo encoding, then coding efficiency is improved, but temporal and phase mismatches between channels cause reduced reliability in coding gains and redundancy
Solution Approach 1:
The patent applies preliminary action by performing temporal alignment and phase correction on audio channels before the stereo encoding process. The encoder determines temporal shift values and applies corrections to align left and right channels, ensuring that coding gains and redundancy are calculated based on properly synchronized signals. This preliminary synchronization resolves the contradiction by eliminating temporal mismatches that would otherwise compromise the reliability of coding parameters while maintaining the efficiency benefits of mid-side and parametric stereo coding.
2Manufacturing precision
If ICBWE gain mapping parameters are extracted and transmitted in the bitstream, then audio quality is maintained, but coding complexity and transmission bandwidth increase
Solution Approach 1:
The patent applies the taking out principle by removing the ICBWE gain mapping parameters from the extraction and transmission process. Instead of extracting these parameters from the frequency-domain channels and including them in the bitstream, the encoder omits this step entirely. The decoder then generates the necessary gain mapping parameters independently using the received stereo parameters (such as inter-channel level differences and phase differences). This approach maintains audio quality by preserving the essential stereo information while significantly reducing coding complexity and transmission bandwidth requirements.
3Measurement precision
If ICBWE gain mapping parameters are extracted and transmitted, then decoder can reconstruct high-band channels accurately, but transmission bandwidth increases
Solution Approach 1:
The patent applies the copying principle by having the decoder generate ICBWE gain mapping parameters as a copy or derivation of the received stereo parameters rather than receiving them directly. The decoder uses the transmitted inter-channel level differences and phase differences to reconstruct the gain mapping parameters locally. This approach achieves reconstruction accuracy comparable to direct transmission while reducing transmission bandwidth, as the decoder recreates the necessary parameters from the essential stereo cues already present in the compressed bitstream.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method includes decoding a low-band mid channel bitstream to generate a low-band mid signal and a low-band mid excitation signal. The method further includes decoding a high-band mid channel bandwidth extension bitstream to generate a synthesized high-band mid signal. The method also includes determining an inter-channel bandwidth extension (ICBWE) gain mapping parameter corresponding to the synthesized high-band mid signal. The ICBWE gain mapping parameter is based on a selected frequency-domain gain parameter that is extracted from a stereo downmix/upmix parameter bitstream. The method further includes performing a gain scaling operation on the synthesized high-band mid signal based on the ICBWE gain mapping parameter to generate a reference high-band channel and a target high-band channel. The method includes outputting a first audio channel and a second audio channel. The first audio channel is based on the reference high-band channel, and the second audio channel is based on target high-band channel.