Audio Decoding Apparatus Packet Loss Concealment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video conferencing systems using UDP for audio and image data transmission suffer from packet loss, leading to weakened packet loss concealment processing in multi-channel systems, as they primarily rely on intra-channel processing which does not effectively utilize inter-channel correlations.
Innovation Solution
An audio decoding method and apparatus that detects packet loss in N-channel systems, extracts signal characteristic parameters from un-lost audio data, and performs packet loss concealment processing based on correlations between channels, using either inter-channel or intra-channel methods depending on the existence of correlations between channels.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If intra-channel packet loss concealment processing is used in multi-channel systems, then the processing is simple to implement, but the packet loss concealment effect is weakened
Solution Approach 1:
The patent combines intra-channel packet loss concealment processing with inter-channel packet loss concealment processing. When packet loss is detected in a first channel, the system first attempts intra-channel concealment using previous audio data from the same channel. If this fails to achieve satisfactory concealment, inter-channel concealment is then applied using audio data from correlated second channels. This merging of two processing approaches allows the system to maintain operational simplicity while significantly improving the overall packet loss concealment effect in multi-channel audio systems.
2Reliability
If inter-channel packet loss concealment processing is used, then the packet loss concealment effect is improved, but the processing complexity increases
Solution Approach 1:
The patent implements a dynamic, conditional processing approach where the system adapts its complexity based on actual packet loss conditions. The processing begins with simple intra-channel concealment and only activates the more complex inter-channel concealment when necessary (when intra-channel methods are insufficient). This dynamic switching mechanism allows the system to achieve improved packet loss concealment效果 while avoiding unnecessary complexity in normal operating conditions.
Solution Approach 2:
The system performs self-assessment of packet loss severity and automatically selects the appropriate concealment strategy. The audio decoding apparatus monitors packet loss in real-time and autonomously determines whether to apply simple or complex concealment methods based on the detected loss patterns and channel correlations, eliminating the need for external control or manual configuration.
3Ease of operation
If all channels are processed independently for packet loss concealment, then channel processing is straightforward, but the overall audio quality deteriorates
Solution Approach 1:
The patent introduces inter-channel correlation as an intermediary mechanism that connects independent channel processing. When packet loss occurs in one channel, the system uses audio data from other channels as intermediate reference material to reconstruct the lost data. This intermediary approach allows channels to maintain their independent processing simplicity while still benefiting from cross-channel information to preserve overall audio quality.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
Embodiments of the present invention disclose an audio decoding method and apparatus. The audio decoding method includes: receiving data packets; when data packet loss is detected and audio data of an audio frame corresponding to M channels in N channels is lost, if audio data of other channels than the M channels in the N channels, which belongs to the same audio frame as the lost audio data in the audio frame, is not lost, decoding the un-lost audio data; extracting a signal characteristic parameter obtained after decoding; determining whether correlation exists between a first channel and a second channel; and if correlation exists between the first channel and the second channel, performing packet loss concealment processing on the lost audio data of the audio frame corresponding to the first channel according to the second channel. Embodiments of the present invention further provide an audio decoding apparatus. Embodiments of the present invention can effectively improve the effect of packet loss concealment processing in audio decoding.