23 results about "Packet loss concealment" patented technology

The invention relates to the technical field of speech recognition, and discloses a real-time speech recognition method based on a Bluetooth audio stream, which comprises the following steps: analyzing bit allocation parameters to calculate quantized bit distribution and generate a frequency domain confidence mask, monitoring a packet loss concealment state flag bit of a decoder, forcibly setting the mask as a blocking threshold when an algorithm is activated, and generating a real-time speech recognition result. According to the method, a cross-level feature purification mechanism based on protocol priori and link states is constructed, acoustic model illusion caused by forged waveforms is blocked through targeted arbitration while deterministic quantization noise is eliminated, and the acoustic model recognition accuracy is improved. And the identification accuracy under a severe channel is ensured.

The invention provides a voice packet loss hiding method and device, electronic equipment and a storage medium, and the method comprises the steps: carrying out the framing processing of a received voice signal, and obtaining a current frame signal and a historical reference frame signal; based on the current frame signal, calculating an LPC coefficient through linear predictive coding LPC analysis; performing echo detection on the current frame signal and the historical reference frame signal, and judging whether an echo exists in the current frame signal; if it is judged that the echo exists, echo cancellation processing is started, and an LPC coefficient is updated based on an echo cancellation result to obtain an updated LPC coefficient; the updated LPC coefficient is used for frame reconstruction when subsequent voice packet loss occurs. According to the invention, through real-time echo detection and elimination of echo components in the reconstructed voice, the core problem of echo generation due to limitation of an LPC model in a transient phase is solved in a targeted manner, so that the reconstructed voice is purer and more natural, and the voice quality is remarkably improved.

To provide a method and system for executing packet loss concealment using a neural network system.SOLUTION: A method includes the steps of obtaining representation of an incomplete audio signal; inputting the representation of the incomplete audio signal to an encoder neural network; and outputting latent representation of a predicted complete audio signal. The latent representation is input to a decoder neural network, which outputs the representation of the predicted complete audio signal including reconfiguration of an original part of the complete audio signal, wherein the encoder neural network and decoder neural network are trained with adversarial networks.SELECTED DRAWING: Figure 7

A method of processing an audio signal for packet loss concealment is described. The audio signal comprises a sequence of frames, each frame containing a representation of a plurality of audio channels and reconstruction parameters for upmixing the plurality of audio channels into a predetermined channel format. A method includes: receiving the audio signal; and generating a reconstructed audio signal in the predefined channel format based on the received audio signal. Generating the reconstructed audio signal includes: determining whether at least one frame of the audio signal has been lost; and fade-in and fade-out the reconstructed audio signal to a predefined spatial configuration if the number of consecutive lost frames exceeds a first threshold. A method of encoding an audio signal is also described. Apparatus for carrying out the method, as well as corresponding programs and computer-readable storage media, are also further described.

A method of processing an audio signal for packet loss concealment is described. The audio signal comprises a sequence of frames, each frame containing a representation of a plurality of audio channels and reconstruction parameters for upmixing the plurality of audio channels into a predetermined channel format. A method includes: receiving the audio signal; and generating a reconstructed audio signal in the predefined channel format based on the received audio signal. Generating the reconstructed audio signal includes: determining whether at least one frame of the audio signal has been lost; and fade-in and fade-out the reconstructed audio signal to a predefined spatial configuration if the number of consecutive lost frames exceeds a first threshold. A method of encoding an audio signal is also described. Apparatus for carrying out the method, as well as corresponding programs and computer-readable storage media, are also further described.

A method of processing an audio signal for packet loss concealment is described. The audio signal comprises a sequence of frames, each frame containing a representation of a plurality of audio channels and reconstruction parameters for upmixing the plurality of audio channels into a predetermined channel format. A method includes: receiving the audio signal; and generating a reconstructed audio signal in the predefined channel format based on the received audio signal. Generating the reconstructed audio signal includes: determining whether at least one frame of the audio signal has been lost; and fade-in and fade-out the reconstructed audio signal to a predefined spatial configuration if the number of consecutive lost frames exceeds a first threshold. A method of encoding an audio signal is also described. Apparatus for carrying out the method, as well as corresponding programs and computer-readable storage media, are also further described.

A method of processing an audio signal for packet loss concealment is described. The audio signal comprises a sequence of frames, each frame containing a representation of a plurality of audio channels and reconstruction parameters for upmixing the plurality of audio channels into a predetermined channel format. A method includes: receiving the audio signal; and generating a reconstructed audio signal in the predefined channel format based on the received audio signal. Generating the reconstructed audio signal includes: determining whether at least one frame of the audio signal has been lost; and fade-in and fade-out the reconstructed audio signal to a predefined spatial configuration if the number of consecutive lost frames exceeds a first threshold. A method of encoding an audio signal is also described. Apparatus for carrying out the method, as well as corresponding programs and computer-readable storage media, are also further described.

Described are methods of processing an audio signal for packet loss concealment. The audio signal comprises a sequence of frames, each frame containing representations of a plurality of audio channels and reconstruction parameters for upmixing the plurality of audio channels to a predetermined channel format. One method includes: receiving the audio signal; and generating a reconstructed audio signal in the predefined channel format based on the received audio signal. Generating the reconstructed audio signal comprises: determining whether at least one frame of the audio signal has been lost; and if a number of consecutively lost frames exceeds a first threshold, fading the reconstructed audio signal to a predefined spatial configuration. Also described is a method of encoding an audio signal. Yet further described are apparatus for carrying out the methods, as well as corresponding programs and computer-readable storage media.

A method is provided for determining whether to suppress valley frequency points in a frequency domain (FD) evolution step of packet loss concealment in a phase error concealment unit in a decoder (200, 191, 2200). The method comprises obtaining (1305) an initial number of peaks, nplocs, and peak position plocs of the audio signal; if the number of peaks indicated by the nplocs is 1 or 2, performing (1307) a non-pure chord analysis using the plocs to determine whether the audio signal is a pure sine curve; in response to determining that the audio signal is not a pure sinusoid, not suppressing (1309) valley frequency points in the FD evolution step; and in response to determining that the audio signal is a pure sinusoid, suppressing (1311) valley frequency points in the FD evolution step.

A method of processing an audio signal for packet loss concealment is described. The audio signal comprises a sequence of frames, each frame containing a representation of a plurality of audio channels and reconstruction parameters for upmixing the plurality of audio channels into a predetermined channel format. A method includes: receiving the audio signal; and generating a reconstructed audio signal in the predefined channel format based on the received audio signal. Generating the reconstructed audio signal includes: determining whether at least one frame of the audio signal has been lost; and fade-in and fade-out the reconstructed audio signal to a predefined spatial configuration if the number of consecutive lost frames exceeds a first threshold. A method of encoding an audio signal is also described. Apparatus for carrying out the method, as well as corresponding programs and computer-readable storage media, are also further described.

An audio coding device for coding an audio signal comprises an audio encoder configured to code the audio signal; and a side information encoder configured to calculate a parameter for a look-ahead signal in code excited linear prediction (CELP) coding as side information, the side information for use in packet loss 10 concealment in the CELP coding. The audio encoder is configured to calculate an index representing characteristics of a frame being coded and transmit the index to the side information encoder. The side information encoder is further configured to include, in response to the frame being coded being a specific frame class, a pitch lag of a next frame coded after the frame being coded, the 15 pitch lag of the next frame included as the side information in the frame being coded. The side information encoder is further configured, in response to the frame being coded not being the specific frame class, to not include the pitch lag of the next frame in the frame being coded, wherein the specific frame class is a type of frame that is affected by a packet loss. 20 24 26 70 59 29 N ov 2 02 4 2 0 2 4 2 6 7 0 5 9 2 9 N o v 2 0 2 4 5 A B S T R A C T

A packet loss concealment system according to one disclosed embodiment comprises: a memory storing an artificial intelligence model composed of a plurality of residual layers; and a processor for training the artificial intelligence model, wherein the processor is configured to: input, to the artificial intelligence model, speech data to which Gaussian noise has been added and noise level embedding; generate a first combined value by combining local conditioning information with the speech data and the noise level embedding through a first feature-wise linear modulation (FiLM) layer; generate a second combined value by combining packet loss embedding with the first combined value through a second FiLM layer; and output noise estimated at each time step by the residual layers through a reverse process.

A packet loss concealment method is described, comprising: determining the current frame in a speech data stream of a target object, the speech data stream including multiple frames of speech data with target speech parameters; responding to packet loss in the current frame, performing a first data processing operation on the current frame, the first data processing operation including the following steps: identifying the current frame as a packet-loss frame; determining predicted speech parameters of the packet-loss frame based on one or more preceding frames using a packet loss concealment model, wherein the packet loss concealment model is established based on historical speech data of multiple objects; correcting the predicted speech parameters of the packet-loss frame using a correction model to obtain corrected speech parameters of the packet-loss frame, wherein the correction model is established based on historical speech data of the target object; and determining the speech data of the packet-loss frame based on the corrected speech parameters of the packet-loss frame. Embodiments of this invention can be applied to various scenarios such as packet loss concealment, data transmission, and voice calls.

A method of processing an audio signal for packet loss concealment is described. The audio signal comprises a sequence of frames, each frame containing a representation of a plurality of audio channels and reconstruction parameters for upmixing the plurality of audio channels into a predetermined channel format. A method includes: receiving the audio signal; and generating a reconstructed audio signal in the predefined channel format based on the received audio signal. Generating the reconstructed audio signal includes: determining whether at least one frame of the audio signal has been lost; and fade-in and fade-out the reconstructed audio signal to a predefined spatial configuration if the number of consecutive lost frames exceeds a first threshold. A method of encoding an audio signal is also described. Apparatus for carrying out the method, as well as corresponding programs and computer-readable storage media, are also further described.

The present disclosure relates to a method and system for hiding lost or corrupted frames of audio content in a sequence of audio frames. The method includes obtaining at least one first frame associated with a sequence of frames and identifying whether a second frame after the at least one first frame is valid or invalid. When the second frame is identified as invalid, the method includes generating a set of time-frequency (TF) block values for replacing a replacement frame of the second frame by applying a sinusoidal extension process to generate a set of TF block values for the replacement frame, or applying a linear prediction process to generate a set of TF block values for the replacement frame, based on a tone degree of at least one previous frame.

A method of processing an audio signal for packet loss concealment is described. The audio signal comprises a sequence of frames, each frame containing a representation of a plurality of audio channels and reconstruction parameters for upmixing the plurality of audio channels into a predetermined channel format. A method includes: receiving the audio signal; and generating a reconstructed audio signal in the predefined channel format based on the received audio signal. Generating the reconstructed audio signal includes: determining whether at least one frame of the audio signal has been lost; and fade-in and fade-out the reconstructed audio signal to a predefined spatial configuration if the number of consecutive lost frames exceeds a first threshold. A method of encoding an audio signal is also described. Apparatus for carrying out the method, as well as corresponding programs and computer-readable storage media, are also further described.

A method, decoder, and program code for filling an analysis window length with a time domain signal for concealing a lost audio frame associated with a received audio signal. A first segment of a previously received part of a received audio signal is copied from a prototype buffer. A second segment of the previously received part of the received audio signal is overlap added from the prototype buffer to an initial portion of a reconstructed part of the received audio signal followed by a remaining portion of the reconstructed part of the received audio signal.

A method, decoder, and program code for filling an analysis window length with a time domain signal for concealing a lost audio frame associated with a received audio signal. A first segment of a previously received part of a received audio signal is copied from a prototype buffer. A second segment of the previously received part of the received audio signal is overlap added from the prototype buffer to an initial portion of a reconstructed part of the received audio signal followed by a remaining portion of the reconstructed part of the received audio signal.

A method of processing an audio signal for packet loss concealment is described. The audio signal comprises a sequence of frames, each frame containing a representation of a plurality of audio channels and reconstruction parameters for upmixing the plurality of audio channels into a predetermined channel format. A method includes: receiving the audio signal; and generating a reconstructed audio signal in the predefined channel format based on the received audio signal. Generating the reconstructed audio signal includes: determining whether at least one frame of the audio signal has been lost; and fade-in and fade-out the reconstructed audio signal to a predefined spatial configuration if the number of consecutive lost frames exceeds a first threshold. A method of encoding an audio signal is also described. Apparatus for carrying out the method, as well as corresponding programs and computer-readable storage media, are also further described.

A packet loss concealment method includes: receiving a speech data packet; determining a speech power spectrum of speech data in the speech data packet in response to determining, according to the speech data packet, that a packet loss occurs; performing lost frame prediction on the speech power spectrum by using a neural network model, to obtain a predicted lost frame power spectrum; and determining restored speech data according to the speech power spectrum and the predicted lost frame power spectrum.

Described are methods of processing an audio signal for packet loss concealment. The audio signal comprises a sequence of frames, each frame containing representations of a plurality of audio channels and reconstruction parameters for upmixing the plurality of audio channels to a predetermined channel format. One method includes: receiving the audio signal; and generating a reconstructed audio signal in the predefined channel format based on the received audio signal. Generating the reconstructed audio signal comprises: determining whether at least one frame of the audio signal has been lost; and if a number of consecutively lost frames exceeds a first threshold, fading the reconstructed audio signal to a predefined spatial configuration. Also described is a method of encoding an audio signal. Yet further described are apparatus for carrying out the methods, as well as corresponding programs and computer-readable storage media.