60results about How to "Improve speech enhancement performance" patented technology

The invention provides a microphone array voice enhancement device with a sound source direction tracking function and a method for the microphone array voice enhancement device. The microphone array voice enhancement device relates to voice signal processing. A microphone array, an adjustable parallel beam former group module, a fixed parameter FIR (Finite Impulse Response) filter module, a fixed parameter signal blocking module, an adaptive noise canceller module and a sound source direction update module are aranged in the devide. The method comprises the following steps of: initializing, forming an adjustable beam, fixing parameter filtering, blocking a signal, carrying out adaptive noise cancelling, and updating a sound source direction. The invention provides an adjustable parallel beam former group combined with a sidelobe canceller structure to achieve real-time tracking of a target sound source direction, embeds the sound source direction tracking function directly to a generalized sidelobe canceller structure, can achieve sound source direction tracking and voice enhancement, thereby overcoming sensibility of an algorithm performance on a DOA (Direction of Arrival) estimation error.

The disclosed forming method for broadband waveform comprises: determining the sub-band signal opposite to the microphone signal, as well as the signal frequency-domain correlation matrix; according to 3D space transmission vector of signal source and former matrix, determining the weight vector for every sub-band signal; then deciding the output signal. This invention combines frequency and space domain for speech process, and improves SNR for wide application.

The invention provides a microphone speech enhancement method and a corresponding device. The method comprises the steps of acquiring first array speech signals which are acquired and inputted through multi-channel digital speech acquisition equipment; calculating optimal beam output signals synthesized by the first array speech signals by adopting the first array voice signals according to a minimum variance adaptive beam optimization model of the first array speech signals; and carrying out single-channel speech enhancement processing by adopting a power spectrum estimation value of the optimal beam output signals, wherein the minimum variance adaptive beam optimization model of the first array speech signals comprises a space guidance vector from a target sound source to the multi-channel digital speech acquisition equipment. The microphone speech enhancement method and the microphone speech enhancement device provided by the invention can process original speech of a speech acquisition equipment array with many array elements and large spacing.

The invention relates to the technical field of speech processing and specifically provides a method and a device for estimating a noise power spectral density of a speech signal. The method comprisesthe following steps: extracting a time context window feature from a noise speech signal, inputting the time context window feature to a pre-trained speech existence probability estimator which outputs an estimated speech existence probability corresponding to a current time frame; correcting the estimated speech existence probability according to a Bayes rule to determine a speech existence probability; determining the noise power spectral density corresponding to the corresponding time frame based on the speech existence probability according to a recursive smoothing formula. Through the technical scheme of the invention, the estimation accuracy of the noise power spectral density is improved in the case of small computing resources, thereby being beneficial to effectively eliminating noise signals, minimizing distortion in the speech processing process and improving speech enhancement performance.

The invention provides a speech enhancement method, a speech enhancement device, a speech enhancement apparatus and a storage medium. The method includes the following steps that: the speech featuresof speech to be enhanced are obtained; the speech features of the speech to be enhanced are inputted into an enhancement model, so that the ideal ratio film (IRM) of the speech to be enhanced is obtained, wherein the enhancement model is a model which is implemented based on a generative adversarial network (GAN) and is used for obtaining the IRM according to the speech features; and the speech enhancement result of the speech to be enhanced is obtained according to the speech features of the speech to be enhanced and the IRM of the speech to be enhanced. With the speech enhancement method, the speech enhancement device, the speech enhancement apparatus and the storage medium of the invention adopted, a speech enhancement effect can be improved.

The invention relates to a speech enhancement method based on a gated cycle encoding and decoding network, and relates to the technical field of speech enhancement. According to the method, the speechenhancement method based on the gated cycle encoding and decoding network is proposed based on the research of the process of human auditory perception aiming at the problem that the conventional speech enhancement method does not employ the connection between context information and a current to-be-enhanced speech frame. In a speech enhancement task, an encoding and decoding architecture is introduced, modeling of multiple adjacent frames of speech signals is performed by employing an encoder to extract the context information, mining of the connection between the current to-be-enhanced speech frame and the context information is performed by employing a decoder, and the speech enhancement performance is improved.

The invention discloses an end-to-end speech enhancement method using stacked multiscale modules. The end-to-end speech enhancement method using the stacked multiscale modules comprises the followingsteps of S1, building a cascading end-to-end speech enhancement frame, and splicing the stacked multiscale modules into a network structure; S2, in the preprocessing stage, converting a time-domain signal into a two-dimensional characteristic; S3, utilizing a speech enhancement module for enhancing the two-dimensional characteristic; and S4, in the postprocessing stage, converting enhanced character representation into a one-dimensional time-domain signal through decoding synthesis. In order to further improve the performance of an algorithm, speech enhancement evaluation indicators STOI and SDR are integrated into a loss function through applying a multi-target joint optimization training strategy. The experiment shows that the method provided by the invention is capable of remarkably improving a speech enhancement effect and has better noise immunity under the conditions of unknown noise and low signal-to-noise ratio.

The invention discloses a speech enhancement method in a music background based on non-negative matrix factorization, and belongs to the field of voice analysis or synthetization, audio analysis or processing. The method provided by the invention comprises the steps of framing and windowing a mixed signal of music and voice, carrying out non-negative matrix factorization to an STFT (The Short-Time Fourier Transform) amplitude spectrum, wherein a basic matrix of the background music is obtained by training and is fixed in a decomposing process, the amplitude spectrum of the voice signal is synthesized according to the decomposing result, and then an enhanced voice signal is restored by combining a phase spectrum of a primary mixed signal. The test can be carried out under the different voice sparsity limitations and temporary continuity limitation, therefore the voice enhancement effect in the music background of the music can be effectively improved by improving the temporary continuity limitation of the background music.

The invention discloses a speech enhancement method and device. The method comprises steps as follows: the characteristic quantity of noise in a silence section of a speech signal is acquired; a noise class matched with the noise in the silence section is determined from multiple preset noise classes according to the characteristic quantity of the noise in the silence section, and the multiple noise classes are acquired after clustering of multiple noise samples according to characteristic information of the multiple noise samples; a noise model corresponding to the noise class matched with the noise in the silence section is determined according to the noise class matched with the noise in the silence section as well as the mapping relation between the noise class and the noise model; speech enhancement is performed on the speech signal according to the noise model corresponding to the noise class matched with the noise in the silence section. With the adoption of the speech enhancement method and device, speech enhancement is performed on the speech signal according to the noise model corresponding to the noise class, and the speech enhancement effect can be improved.

The invention provides a single-channel speech enhancement method based on joint dictionary learning and sparse representation. Carrying out dual-tree complex wavelet transform on the clean voice to obtain a group of sub-band signals, carrying out short-time Fourier transform on the sub-band signals to obtain a time-frequency spectrum of the sub-band signals, learning a joint dictionary of the clean voice by utilizing the amplitude, the real part, the imaginary part and the voice sparsity of the sub-band signals, and learning a joint dictionary of the clean noise as well; carrying out dual-tree complex wavelet transform and short-time Fourier transform on the noisy speech; obtaining a time-frequency spectrum of each sub-band signal; phase and real part imaginary part symbols are reserved;amplitude, real part and imaginary part absolute values are extracted and projected on the clean voice and clean noise joint dictionary; according to the method, the sparse representation coefficientsof the voice and the noise are obtained, the final estimation of the sub-band voice time-frequency spectrum is obtained by using the coefficients, the time-frequency spectrum phase, the real part imaginary part symbol, the mask, the weight and the like, and the enhanced voice signal is obtained by performing short-time inverse Fourier transform and dual-tree complex wavelet inverse transform, sothat the voice enhancement capability is improved.

The invention provides a voice enhancement method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining collected original voice, carrying out the noise reduction of the original voice, and obtaining noise-reduced voice; determining a speech enhancement mask of the original speech based on the original speech and the noise reduction speech; and performing voice enhancement on the original voice based on a voice enhancement mask. According to the embodiment of the invention, the original voice information and the noise reduction voice information are fused into the voice enhancement mask, so the voice enhancement mask can accurately learn the mapping relation from the original voice with noise to the clean voice, and the voice enhancement effect is improved.

The invention provides a speech enhancement method based on a time-frequency domain joint loss function. The method comprises steps: integrating a clean voice data set and a noise data set in an open source data set into a noisy voice data set, converting the noisy voice data set into an amplitude spectrum, a phase spectrum and waveform data through preprocessing operation, and constructing a training set; constructing a CNN network model, taking the noisy voice amplitude spectrum as input, taking the clean voice amplitude spectrum as a label, and carrying out model training; performing waveform reconstruction on an amplitude spectrum estimation value output by the model and a noisy speech phase spectrum through an inverse short-time Fourier transform method to obtain a time domain waveform of estimated speech; calculating frequency domain loss through the clean voice amplitude spectrum and the amplitude spectrum estimated value; calculating time domain loss through the clean voice time domain waveform and the estimated voice time domain waveform; and constructing time-frequency domain joint loss according to the frequency domain loss and the time domain loss, and guiding the CNN network model to perform weight optimization. The phenomenon that the estimated amplitude spectrum is not matched with the phase spectrum is reduced, and the speech enhancement effect is improved.

The invention discloses a speech enhancement method and a device thereof, equipment and a medium. The method comprises the following steps: acquiring a target noisy voice signal and performing short-time Fourier transform on the target noisy voice signal to obtain a target frequency domain signal corresponding to the target noisy voice signal; inputting the target feature of the current signal frame of the target frequency domain signal into an encoder in a voice noise suppression model obtained by pre-training to obtain an encoding feature corresponding to the current signal frame of the target frequency domain signal; inputting the coding feature and a decoding feature corresponding to a previous signal frame of a current signal frame of a target frequency domain signal output by a decoder in a voice noise suppression model into the decoder to obtain a decoding feature corresponding to the current signal frame of the target frequency domain signal; and performing signal reconstruction on the decoding features corresponding to each signal frame of the target frequency domain signal to obtain a target enhanced voice signal corresponding to the target noisy voice signal. According to the technical scheme, the speech enhancement effect can be improved, and calculation time and calculation cost are reduced.

The invention discloses voice signal enhancement method, device and equipment. The method comprises the following steps of: acquiring a voice signal and geographical position information correspondingto the voice signal; and matching an environment scene type for a voice field corresponding to the voice signal according to the geographic position information, eliminating the environment noise inthe voice signal according to the environment scene type, identifying required voice data from the voice signal after the environment noise is eliminated, and enhancing the identified voice data. Through the above mode, the interference of the environmental noise contained in the voice signal can be reduced, the accuracy of voice recognition from the voice signal is improved, and the effect of voice enhancement of the recognized voice can be improved.

The invention discloses an environment adaptive voice enhancement algorithm based on an attention-driven circulating convolution network. The environment adaptive voice enhancement algorithm comprisesthe following steps that 1, a voice enhancement task database is selected, and input data preparation is conducted; 2, amplitude information and environment information of voice are extracted, wherein the environment information of the voice is extracted by adopting a weight prediction error (WPE) method, and the amplitude information of the voice is voice spectrum information extracted through Fourier transform; 3, a depth model is constructed and trained; and 4, voice reconstructing is conducted, specifically, voice amplitude predicted in the step 3 is converted into a voice waveform. According to the environment adaptive voice enhancement algorithm, the environment information of the voice is considered, and environmental adaptability and robustness of the algorithm in different environments are improved; and in the aspect of real voice signal retention, an attention mechanism is fused to construct the attention-driven circulating convolution network, time-sequence context information of the voice is depicted more precisely, and performance of voice enhancement is effectively improved.

The invention relates to artificial intelligence, and provides an audio noise reduction method and device, equipment and a storage medium. The method comprises the following steps: pre-processing noise frequency to obtain frequency spectrum information, processing the frequency spectrum information based on a frequency domain signal processing network to obtain frequency spectrum mask features, acquiring time-frequency features according to the frequency spectrum information and the frequency spectrum mask features, processing the time-frequency features based on a time domain signal processing network to obtain time-frequency mask features, generating a predicted audio according to the time-frequency features and the time-frequency mask features, adjusting network parameters of a preset learner based on the predicted audio and the pure audio to obtain a noise reduction model, acquiring a request audio, and performing noise reduction processing on the request audio based on the noise reduction model to obtain a target audio. According to the method, the noise reduction accuracy and real-time performance of the request audio can be improved. In addition, the invention also relates to a block chain technology, and the target audio can be stored in a block chain.