34 results about "Packet loss concealment" patented technology

The invention relates to the technical field of speech recognition, and discloses a real-time speech recognition method based on a Bluetooth audio stream, which comprises the following steps: analyzing bit allocation parameters to calculate quantized bit distribution and generate a frequency domain confidence mask, monitoring a packet loss concealment state flag bit of a decoder, forcibly setting the mask as a blocking threshold when an algorithm is activated, and generating a real-time speech recognition result. According to the method, a cross-level feature purification mechanism based on protocol priori and link states is constructed, acoustic model illusion caused by forged waveforms is blocked through targeted arbitration while deterministic quantization noise is eliminated, and the acoustic model recognition accuracy is improved. And the identification accuracy under a severe channel is ensured.

The present disclosure relates to a method and system for performing packet loss concealment using a neural network system. The method comprises obtaining a representation of an incomplete audio signal, inputting the representation of the incomplete audio signal to an encoder neural network and outputting a latent representation of a predicted complete audio signal. The latent representation is input to a decoder neural network which outputs a representation of a predicted complete audio signal comprising a reconstruction of the original portion of the complete audio signal, wherein said encoder neural network and said decoder neural network have been trained with an adversarial neural network.

A method of performing packet loss concealment in a neural audio encoder / decoder (codec) system. The method includes receiving an indication of a lost audio packet at a receive side of a neural network audio codec system that includes an audio encoder and an audio decoder, wherein the lost audio packet comprises an index of a codeword that is representative of a portion of speech audio presented to the audio encoder, predicting the index of the codeword in the lost packet to obtain a predicted index, deriving a predicted embedding vector from the predicted index, and decoding, by the audio decoder, the embedding vector to generate an audio output.

The invention provides a voice packet loss hiding method and device, electronic equipment and a storage medium, and the method comprises the steps: carrying out the framing processing of a received voice signal, and obtaining a current frame signal and a historical reference frame signal; based on the current frame signal, calculating an LPC coefficient through linear predictive coding LPC analysis; performing echo detection on the current frame signal and the historical reference frame signal, and judging whether an echo exists in the current frame signal; if it is judged that the echo exists, echo cancellation processing is started, and an LPC coefficient is updated based on an echo cancellation result to obtain an updated LPC coefficient; the updated LPC coefficient is used for frame reconstruction when subsequent voice packet loss occurs. According to the invention, through real-time echo detection and elimination of echo components in the reconstructed voice, the core problem of echo generation due to limitation of an LPC model in a transient phase is solved in a targeted manner, so that the reconstructed voice is purer and more natural, and the voice quality is remarkably improved.

To provide a method and system for executing packet loss concealment using a neural network system.SOLUTION: A method includes the steps of obtaining representation of an incomplete audio signal; inputting the representation of the incomplete audio signal to an encoder neural network; and outputting latent representation of a predicted complete audio signal. The latent representation is input to a decoder neural network, which outputs the representation of the predicted complete audio signal including reconfiguration of an original part of the complete audio signal, wherein the encoder neural network and decoder neural network are trained with adversarial networks.SELECTED DRAWING: Figure 7

A method of processing an audio signal for packet loss concealment is described. The audio signal comprises a sequence of frames, each frame containing a representation of a plurality of audio channels and reconstruction parameters for upmixing the plurality of audio channels into a predetermined channel format. A method includes: receiving the audio signal; and generating a reconstructed audio signal in the predefined channel format based on the received audio signal. Generating the reconstructed audio signal includes: determining whether at least one frame of the audio signal has been lost; and fade-in and fade-out the reconstructed audio signal to a predefined spatial configuration if the number of consecutive lost frames exceeds a first threshold. A method of encoding an audio signal is also described. Apparatus for carrying out the method, as well as corresponding programs and computer-readable storage media, are also further described.

The application discloses a method and device for calculating pitch period in packet loss concealment and a readable medium, wherein the method obtains the pitch period through a correlation coefficient method, and in the calculation process of the correlation coefficient, the calculation of the total energy of a template window and x2 is removed, the calculation process of the total energy of a sliding window and y2 is adjusted, and a Taylor expansion method is used to obtain an approximation equation, the operation of 1 / sqrt(z) is approximately replaced by the approximation equation, which is equivalent to removing the division and square root (sqrt) operation in the previous algorithm and replacing them only with multiplication, shifting and addition and subtraction, so that the total calculation amount is greatly reduced, even if the hardware acceleration circuit is implemented in this way, the hardware area is greatly reduced, and cost and power consumption can be effectively saved.

A method of processing an audio signal for packet loss concealment is described. The audio signal comprises a sequence of frames, each frame containing a representation of a plurality of audio channels and reconstruction parameters for upmixing the plurality of audio channels into a predetermined channel format. A method includes: receiving the audio signal; and generating a reconstructed audio signal in the predefined channel format based on the received audio signal. Generating the reconstructed audio signal includes: determining whether at least one frame of the audio signal has been lost; and fade-in and fade-out the reconstructed audio signal to a predefined spatial configuration if the number of consecutive lost frames exceeds a first threshold. A method of encoding an audio signal is also described. Apparatus for carrying out the method, as well as corresponding programs and computer-readable storage media, are also further described.

A method of processing an audio signal for packet loss concealment is described. The audio signal comprises a sequence of frames, each frame containing a representation of a plurality of audio channels and reconstruction parameters for upmixing the plurality of audio channels into a predetermined channel format. A method includes: receiving the audio signal; and generating a reconstructed audio signal in the predefined channel format based on the received audio signal. Generating the reconstructed audio signal includes: determining whether at least one frame of the audio signal has been lost; and fade-in and fade-out the reconstructed audio signal to a predefined spatial configuration if the number of consecutive lost frames exceeds a first threshold. A method of encoding an audio signal is also described. Apparatus for carrying out the method, as well as corresponding programs and computer-readable storage media, are also further described.

A method of processing an audio signal for packet loss concealment is described. The audio signal comprises a sequence of frames, each frame containing a representation of a plurality of audio channels and reconstruction parameters for upmixing the plurality of audio channels into a predetermined channel format. A method includes: receiving the audio signal; and generating a reconstructed audio signal in the predefined channel format based on the received audio signal. Generating the reconstructed audio signal includes: determining whether at least one frame of the audio signal has been lost; and fade-in and fade-out the reconstructed audio signal to a predefined spatial configuration if the number of consecutive lost frames exceeds a first threshold. A method of encoding an audio signal is also described. Apparatus for carrying out the method, as well as corresponding programs and computer-readable storage media, are also further described.

An audio encoding device for encoding an audio signal consisting of a plurality of frames, the audio encoding device comprising: an audio encoding unit for encoding the audio signal; and an auxiliary information encoding unit for estimating and encoding auxiliary information about a temporal change of power of the audio signal, the auxiliary information being used in packet loss concealment in decoding of the audio signal, wherein the auxiliary information encoding unit estimates and encodes quantized transient power and a flag of sudden change of power, as the auxiliary information.

Described are methods of processing an audio signal for packet loss concealment. The audio signal comprises a sequence of frames, each frame containing representations of a plurality of audio channels and reconstruction parameters for upmixing the plurality of audio channels to a predetermined channel format. One method includes: receiving the audio signal; and generating a reconstructed audio signal in the predefined channel format based on the received audio signal. Generating the reconstructed audio signal comprises: determining whether at least one frame of the audio signal has been lost; and if a number of consecutively lost frames exceeds a first threshold, fading the reconstructed audio signal to a predefined spatial configuration. Also described is a method of encoding an audio signal. Yet further described are apparatus for carrying out the methods, as well as corresponding programs and computer-readable storage media.

A method is provided for determining whether to suppress valley frequency points in a frequency domain (FD) evolution step of packet loss concealment in a phase error concealment unit in a decoder (200, 191, 2200). The method comprises obtaining (1305) an initial number of peaks, nplocs, and peak position plocs of the audio signal; if the number of peaks indicated by the nplocs is 1 or 2, performing (1307) a non-pure chord analysis using the plocs to determine whether the audio signal is a pure sine curve; in response to determining that the audio signal is not a pure sinusoid, not suppressing (1309) valley frequency points in the FD evolution step; and in response to determining that the audio signal is a pure sinusoid, suppressing (1311) valley frequency points in the FD evolution step.

A method of sampling output audio samples includes, during a packet loss concealment event, obtaining a sequence of previous output audio samples. At each time step during the event, the method includes generating a probability distribution over possible output audio samples for the time step. Each sample includes a respective probability indicating a likelihood that the corresponding sample represents a portion of an utterance at the time step. The method also includes determining a temperature sampling value based on a function of a number of time steps that precedes the time step, and an initial, a minimum, and a maximum temperature sampling value. The method also includes applying the temperature sampling value to the probability distribution to adjust a probability of selecting possible samples and randomly selecting one of the possible samples based on the adjusted probability. The method also includes generating synthesized speech using the randomly selected sample.

The present disclosure relates to a method and system for performing packet loss concealment using a neural network system. The method comprises obtaining a representation of an incomplete audio signal, inputting the representation of the incomplete audio signal to an encoder neural network and outputting a latent representation of a predicted complete audio signal. The latent representation is input to a decoder neural network which outputs a representation of a predicted complete audio signal comprising a reconstruction of the original portion of the complete audio signal, wherein said encoder neural network and said decoder neural network have been trained with an adversarial neural network.

A method of processing an audio signal for packet loss concealment is described. The audio signal comprises a sequence of frames, each frame containing a representation of a plurality of audio channels and reconstruction parameters for upmixing the plurality of audio channels into a predetermined channel format. A method includes: receiving the audio signal; and generating a reconstructed audio signal in the predefined channel format based on the received audio signal. Generating the reconstructed audio signal includes: determining whether at least one frame of the audio signal has been lost; and fade-in and fade-out the reconstructed audio signal to a predefined spatial configuration if the number of consecutive lost frames exceeds a first threshold. A method of encoding an audio signal is also described. Apparatus for carrying out the method, as well as corresponding programs and computer-readable storage media, are also further described.

A method, decoder and program code for filling an analysis window length with a time domain signal to hide lost audio frames associated with a received audio signal. A first segment of a previously received portion of the received audio signal is replicated from the prototype buffer. A second segment of a previously received portion of the received audio signal is overadded from the prototype buffer to an initial portion of a reconstructed portion of the received audio signal, followed by a remaining portion of the reconstructed portion of the received audio signal.

An audio coding device for coding an audio signal comprises an audio encoder configured to code the audio signal; and a side information encoder configured to calculate a parameter for a look-ahead signal in code excited linear prediction (CELP) coding as side information, the side information for use in packet loss 10 concealment in the CELP coding. The audio encoder is configured to calculate an index representing characteristics of a frame being coded and transmit the index to the side information encoder. The side information encoder is further configured to include, in response to the frame being coded being a specific frame class, a pitch lag of a next frame coded after the frame being coded, the 15 pitch lag of the next frame included as the side information in the frame being coded. The side information encoder is further configured, in response to the frame being coded not being the specific frame class, to not include the pitch lag of the next frame in the frame being coded, wherein the specific frame class is a type of frame that is affected by a packet loss. 20 24 26 70 59 29 N ov 2 02 4 2 0 2 4 2 6 7 0 5 9 2 9 N o v 2 0 2 4 5 A B S T R A C T

A packet loss concealment system according to one disclosed embodiment comprises: a memory storing an artificial intelligence model composed of a plurality of residual layers; and a processor for training the artificial intelligence model, wherein the processor is configured to: input, to the artificial intelligence model, speech data to which Gaussian noise has been added and noise level embedding; generate a first combined value by combining local conditioning information with the speech data and the noise level embedding through a first feature-wise linear modulation (FiLM) layer; generate a second combined value by combining packet loss embedding with the first combined value through a second FiLM layer; and output noise estimated at each time step by the residual layers through a reverse process.

A packet loss concealment method is described, comprising: determining the current frame in a speech data stream of a target object, the speech data stream including multiple frames of speech data with target speech parameters; responding to packet loss in the current frame, performing a first data processing operation on the current frame, the first data processing operation including the following steps: identifying the current frame as a packet-loss frame; determining predicted speech parameters of the packet-loss frame based on one or more preceding frames using a packet loss concealment model, wherein the packet loss concealment model is established based on historical speech data of multiple objects; correcting the predicted speech parameters of the packet-loss frame using a correction model to obtain corrected speech parameters of the packet-loss frame, wherein the correction model is established based on historical speech data of the target object; and determining the speech data of the packet-loss frame based on the corrected speech parameters of the packet-loss frame. Embodiments of this invention can be applied to various scenarios such as packet loss concealment, data transmission, and voice calls.

A method of processing an audio signal for packet loss concealment is described. The audio signal comprises a sequence of frames, each frame containing a representation of a plurality of audio channels and reconstruction parameters for upmixing the plurality of audio channels into a predetermined channel format. A method includes: receiving the audio signal; and generating a reconstructed audio signal in the predefined channel format based on the received audio signal. Generating the reconstructed audio signal includes: determining whether at least one frame of the audio signal has been lost; and fade-in and fade-out the reconstructed audio signal to a predefined spatial configuration if the number of consecutive lost frames exceeds a first threshold. A method of encoding an audio signal is also described. Apparatus for carrying out the method, as well as corresponding programs and computer-readable storage media, are also further described.

A method, decoder, and program code for filling an analysis window length with a time-domain signal to hide lost audio frames associated with a received audio signal. Copy a first segment of a previously received portion of the received audio signal from a prototype buffer. Overlap-add a second segment of the previously received portion of the received audio signal from the prototype buffer to an initial portion of a reconstructed portion of the received audio signal, followed by a remaining portion of the reconstructed portion of the received audio signal.

The present disclosure relates to a method and system for hiding lost or corrupted frames of audio content in a sequence of audio frames. The method includes obtaining at least one first frame associated with a sequence of frames and identifying whether a second frame after the at least one first frame is valid or invalid. When the second frame is identified as invalid, the method includes generating a set of time-frequency (TF) block values for replacing a replacement frame of the second frame by applying a sinusoidal extension process to generate a set of TF block values for the replacement frame, or applying a linear prediction process to generate a set of TF block values for the replacement frame, based on a tone degree of at least one previous frame.

A method of processing an audio signal for packet loss concealment is described. The audio signal comprises a sequence of frames, each frame containing a representation of a plurality of audio channels and reconstruction parameters for upmixing the plurality of audio channels into a predetermined channel format. A method includes: receiving the audio signal; and generating a reconstructed audio signal in the predefined channel format based on the received audio signal. Generating the reconstructed audio signal includes: determining whether at least one frame of the audio signal has been lost; and fade-in and fade-out the reconstructed audio signal to a predefined spatial configuration if the number of consecutive lost frames exceeds a first threshold. A method of encoding an audio signal is also described. Apparatus for carrying out the method, as well as corresponding programs and computer-readable storage media, are also further described.

A method, decoder, and program code for filling an analysis window length with a time domain signal for concealing a lost audio frame associated with a received audio signal. A first segment of a previously received part of a received audio signal is copied from a prototype buffer. A second segment of the previously received part of the received audio signal is overlap added from the prototype buffer to an initial portion of a reconstructed part of the received audio signal followed by a remaining portion of the reconstructed part of the received audio signal.

A neural network-based voice packet loss concealment method and device. The method comprises: acquiring a pre-trained neural network used for voice packet loss concealment; receiving an audio to be processed and frame loss position information corresponding to said audio; and inputting an input feature generated on the basis of said audio and the frame loss position information corresponding to said audio into the neural network to obtain a packet-loss-concealed audio corresponding to said audio.

A method, decoder, and program code for filling an analysis window length with a time domain signal for concealing a lost audio frame associated with a received audio signal. A first segment of a previously received part of a received audio signal is copied from a prototype buffer. A second segment of the previously received part of the received audio signal is overlap added from the prototype buffer to an initial portion of a reconstructed part of the received audio signal followed by a remaining portion of the reconstructed part of the received audio signal.

A method of processing an audio signal for packet loss concealment is described. The audio signal comprises a sequence of frames, each frame containing a representation of a plurality of audio channels and reconstruction parameters for upmixing the plurality of audio channels into a predetermined channel format. A method includes: receiving the audio signal; and generating a reconstructed audio signal in the predefined channel format based on the received audio signal. Generating the reconstructed audio signal includes: determining whether at least one frame of the audio signal has been lost; and fade-in and fade-out the reconstructed audio signal to a predefined spatial configuration if the number of consecutive lost frames exceeds a first threshold. A method of encoding an audio signal is also described. Apparatus for carrying out the method, as well as corresponding programs and computer-readable storage media, are also further described.