Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device for frame loss compensation in transform domain

A compensation method and transform domain technology, applied in the field of speech and audio coding and decoding, can solve the problems of high memory consumption, poor signal compensation effect, long delay time, etc.

Active Publication Date: 2018-08-28
ZTE CORP
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although this method is simple to implement and has no delay, the compensation effect is general; other compensation methods such as GAPES (Gap Data Amplitude Phase Estimation Technology) need to convert MDCT coefficients into DSTFT (Discrete Short-Time Fourier Transform) coefficients before compensation , this method has high computational complexity and consumes a lot of memory; another method uses shaping noise insertion technology to compensate voice and audio frame loss. This method has a good compensation effect on noise-like signals, but has a poor compensation effect on harmonic audio signals
[0004] To sum up, most of the relevant transform domain frame loss compensation techniques have no obvious effects, high computational complexity and long delay time, or poor compensation effects for some signals

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for frame loss compensation in transform domain
  • Method and device for frame loss compensation in transform domain
  • Method and device for frame loss compensation in transform domain

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0175] As shown in FIG. 2(A), the frame loss compensation method in the transform domain of this embodiment includes:

[0176] Step 101: Use the frequency domain coefficients of the previous frame or several frames of the current lost frame to calculate the frequency domain coefficients of the current lost frame, and perform frequency-time domain transformation on the calculated frequency domain coefficients to obtain the initial compensation of the current lost frame Signal;

[0177] The number of frames is two or more frames.

[0178] Step 102: adjusting the waveform of the initial compensation signal to obtain the compensation signal of the current lost frame;

[0179] Step 101 and step 102 will be specifically described below in conjunction with the accompanying drawings.

[0180] As shown in Figure 2 (B), the specific methods for calculating the frequency domain coefficients of the current lost frame include:

[0181] Step 1: Appropriately attenuate the frequency domai...

Embodiment 2

[0239] Step 201: Obtain the phase and amplitude of each frequency point of several frames before the current lost frame, and use the phase and amplitude of each frequency point of several frames before the current lost frame to linearly or nonlinearly extrapolate to obtain the phase of each frequency point of the current lost frame and amplitude, the frequency domain coefficients of each frequency point of the current lost frame are obtained through the phase and amplitude of each frequency point of the current lost frame;

[0240] Step 202: Obtain the current frame loss compensation signal through frequency domain-time domain transformation.

[0241] Such as Figure 5 , in step 201, if the frequency domain representation of each information frame in the codec is in the MDCT domain, then it is necessary to use MDST (modified discrete sine transform) to construct the complex signal of the MDCT-MDST domain of several frames before the current missing frame , the method in step ...

Embodiment 3

[0260] Through the judgment algorithm, choose to use the method of embodiment 1 or embodiment 2 to compensate the current lost frame.

[0261] Such as Figure 6 As shown, the judgment algorithm includes:

[0262] Step 301: Calculate the spectral flatness of each frame, judge whether the value of spectral flatness is less than the tenth threshold K, if less than K, then consider that the frame is a tone frame, and set the frame type identification bit as tone type (for example, 1); If not less than K, then think that this frame is non-tone frame, set frame type identification bit as non-tone type (for example be 0), wherein 0≤K≤1;

[0263] The calculation method of specific spectral flatness is as follows:

[0264] The spectral flatness SFM of any i-th frame i Defined as the ratio of the geometric mean to the arithmetic mean of the amplitude of the signal in the transform domain of the i-th frame signal:

[0265]

[0266] in, is the geometric mean of the signal amplitu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a frame loss compensation method and a frame loss compensation device for a transform domain. The method comprises the following steps: the frequency-domain coefficient of a current lost frame is calculated by using the frequency-domain coefficient of a previous frame or frequency-domain coefficients of multiple previous frames of the current lost frame, and frequency domain-time domain transform is performed to obtain an initial compensation signal; and waveform regulation is performed to obtain a compensation signal so as to reduce the operation complexity and achieve a better compensation effect. Or, for all or part of frequency points of the current lost frame, extrapolation is performed on phases and amplitudes of corresponding frequency points of multiple previous frames to obtain phases and amplitudes of corresponding frequency points of the current lost frame and to further obtain frequency-domain coefficients of the corresponding frequency points, and frequency domain-time domain transform is performed to obtain a compensation signal, thus greatly improving the tone frame compensation effect. The method can be selected through a judging algorithm to compensate the current lost frame to achieve a better compensation effect. A voice signal frame and a music signal frame are processed in a differentiated mode, and a good compensation effect can be achieved in a variety of scenarios. Through gain adjustment, the compensation energy is stabilized and the compensation noise is reduced.

Description

technical field [0001] The invention relates to the field of speech and audio coding and decoding, in particular to a frame loss compensation method and device in a transform domain. Background technique [0002] In network communication, packet technology is widely used. Various forms of information such as voice or audio data are encoded and then transmitted on the network using packet technology, such as VoIP (Voice over Internet Protocol) and so on. Due to the limitation of the transmission capacity of the information sending end, or the packet information frame does not reach the buffer of the receiving end within the specified delay time, or the frame information is lost due to network congestion, etc., resulting in a sharp decline in the synthesized sound quality at the decoding end, it is necessary to use compensation technology to compensate for lost frame data. The frame loss compensation technology is a technology to alleviate the sound quality degradation caused...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G10L19/005G10L21/0332
Inventor 关旭袁浩刘末飞
Owner ZTE CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com