Audio Decoder Temporal Mismatch Compensation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In audio encoding, the temporal mismatch between multiple microphones leads to increased bit usage in encoding side channel signals, reducing coding efficiency due to misalignment of audio signals, which affects the performance of stereo coding techniques like mid-side and parametric stereo coding.
Innovation Solution
A device and method that include a receiver and decoder configured to receive an encoded bitstream with temporal mismatch values and stereo parameters, performing inverse transforms and causal shifts to align audio signals, allowing for efficient up-mixing and decoding of mid and side channels, thereby improving coding efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If audio signals from multiple microphones are encoded using stereo-encoding to generate mid and side channel signals, then the audio signals can be efficiently compressed and transmitted, but the temporal misalignment between microphones increases the difference between audio signals requiring higher bit usage to encode the side channel signal
Solution Approach 1:
The patent applies preliminary action by performing temporal alignment of audio signals from multiple microphones before encoding. The system determines temporal shift values between microphones and adjusts the audio signals to compensate for timing differences prior to generating mid and side channel signals. This preprocessing step ensures that the signals are properly aligned, reducing the bit usage required for encoding while maintaining coding efficiency.
2Reliability
If multiple microphones are used to capture audio signals, then the spatial audio coverage and quality are improved, but the temporal mismatch between microphones increases the complexity of encoding and reduces coding efficiency
Solution Approach 1:
The patent applies parameter changes by dynamically adjusting temporal shift values based on the relative positions of microphones and sound sources. The system calculates and applies compensation parameters to align audio signals from multiple microphones, maintaining high audio quality while managing encoding complexity through adaptive parameter adjustment rather than fixed complex processing.
3Device complexity
If the temporal misalignment between microphones is not compensated, then the encoding process is simpler, but the difference between audio signals increases requiring higher bit usage
Solution Approach 1:
The patent performs preliminary temporal alignment of audio signals before encoding by determining temporal shift values between microphones and adjusting the signals accordingly. This preprocessing step compensates for timing differences, reducing the bit usage required for side channel encoding while keeping the overall encoding process manageable through systematic parameter adjustment.
Data Source
AI summary
A device includes a receiver configured to receive an encoded bitstream from a second device. The encoded bitstream includes a temporal mismatch value. The device also includes a decoder configured to decode the encoded bitstream to generate a first signal and a second signal. Based on the temporal mismatch value, the decoder is configured to map one of the first signal or the second signal as a decoded target channel. The decoder is also configured to perform a shift operation on the decoded target channel based on the temporal mismatch value to generate an adjusted decoded target channel. The device also includes an output device configured to output a first output signal and a second output signal. The second output signal is based on the adjusted decoded target channel.