Audio Packet Loss Compensation Using Frequency-Domain Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio processing methods for packet loss during data transmission suffer from cumulative errors in iterative prediction, leading to inaccurate compensation of lost audio packets, which degrades user experience.
Innovation Solution
An audio processing method that utilizes a non-autoregressive algorithm model to transform audio data from the time domain to the frequency domain, performing upsampling and convolution on frequency spectrum information to compensate for missing segments, followed by audio prediction and fusion to generate accurate and smooth compensated audio data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If autoregressive iterative prediction method is used for compensation and recovery of lost audio packets, then the method can provide a solution for packet loss, but cumulative errors occur during iterative prediction leading to inaccurate compensation
Solution Approach 1:
The patent segments the audio processing into frequency domain analysis and time domain synthesis. By transforming audio data to frequency domain, processing missing packets separately in frequency domain using spectral interpolation, then transforming back to time domain, the method avoids cumulative errors of iterative time-domain prediction while maintaining compensation accuracy.
Solution Approach 2:
The patent introduces frequency domain as an intermediary representation between the original audio data and the compensated output. By using frequency domain transformation (FFT) and inverse transformation as mediators, the system can perform spectral analysis and interpolation without the cumulative error propagation inherent in direct time-domain iterative prediction.
2Measurement precision
If frequency domain transformation and spectral interpolation are used for packet loss compensation, then prediction accuracy is improved, but computational complexity increases
Solution Approach 1:
The patent applies partial frequency domain processing by performing FFT only on the portions of audio data containing missing packets and their neighboring regions, rather than transforming the entire audio stream. This selective processing maintains prediction accuracy where needed while reducing overall computational complexity.
Solution Approach 2:
The patent changes the representation parameters of audio data from time domain samples to frequency domain spectra. By operating in the frequency domain where spectral interpolation is more efficient and accurate, the method achieves better prediction results with manageable computational requirements through parameter transformation.
Data Source
Figure 1a~1b
Figure 2
Figure 3a~3b
AI summary
Disclosed in the embodiments of the present invention are an audio processing method, a related device, a storage medium and a program product. The method comprises: acquiring target audio data to be processed and spectrum information of the target audio data, wherein an audio missing segment is present in the target audio data, and the spectrum information comprises spectrum features of context audio segments of the audio missing segment; performing feature compensation processing on the spectrum information of the target audio data according to the spectrum features of the context audio segments, so as to obtain compensated spectrum information corresponding to the target audio data; performing audio prediction by using the compensated spectrum information, so as to obtain predicted audio data; and compensating for the audio missing segment in the target audio data according to the predicted audio data, so as to obtain compensated audio data of the target audio data. By means of the present invention, the accuracy of the prediction and compensation of lost packet audio can be improved.