Environment adaptive voice enhancement algorithm based on attention-driven circulating convolution network

A speech enhancement and cyclic convolution technology, applied in speech analysis, instruments, etc., can solve the problem that speech enhancement models are difficult to adapt to different noise environments, and achieve the effects of improving environmental adaptability, performance, and robustness.

Active Publication Date: 2019-09-10
TIANJIN UNIV
View PDF5 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Aiming at the problem that the existing speech enhancement model is difficult to adapt to different noise environments, the present invention proposes an environment-adaptive speech enhancement algorithm based on attention-driven circular convolution network, thereby improving the environmental adaptability of the algorithm in different environments Algorithmic Robustness

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Environment adaptive voice enhancement algorithm based on attention-driven circulating convolution network
  • Environment adaptive voice enhancement algorithm based on attention-driven circulating convolution network
  • Environment adaptive voice enhancement algorithm based on attention-driven circulating convolution network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] In order to better understand the technical solution of the present invention, the present invention will be described in further detail in conjunction with the accompanying drawings and specific embodiments

[0043] figure 1 It is a framework diagram of an environment-adaptive speech enhancement algorithm based on the attention-driven circular convolution network of the present invention, and mainly includes the following steps:

[0044] Step 1, input data preparation: In order to verify the effect of the present invention, a speech enhancement experiment is carried out in the REVERBChallenge2014 database. The sampling frequency of all sentences in REVERBChallenge2014 is 16KHz.

[0045] Step 2, amplitude feature and environment feature extraction:

[0046] 1) Amplitude feature extraction: Pre-emphasize, frame, window, and fast Fourier transform each segment of the speech signal. The number of FFT points is set to 512, the window length is 512, the window shift is 256...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an environment adaptive voice enhancement algorithm based on an attention-driven circulating convolution network. The environment adaptive voice enhancement algorithm comprisesthe following steps that 1, a voice enhancement task database is selected, and input data preparation is conducted; 2, amplitude information and environment information of voice are extracted, wherein the environment information of the voice is extracted by adopting a weight prediction error (WPE) method, and the amplitude information of the voice is voice spectrum information extracted through Fourier transform; 3, a depth model is constructed and trained; and 4, voice reconstructing is conducted, specifically, voice amplitude predicted in the step 3 is converted into a voice waveform. According to the environment adaptive voice enhancement algorithm, the environment information of the voice is considered, and environmental adaptability and robustness of the algorithm in different environments are improved; and in the aspect of real voice signal retention, an attention mechanism is fused to construct the attention-driven circulating convolution network, time-sequence context information of the voice is depicted more precisely, and performance of voice enhancement is effectively improved.

Description

technical field [0001] The invention belongs to the technical field of speech enhancement, in particular to an environment-adaptive speech enhancement algorithm based on an attention-driven circular convolution network. Background technique [0002] With the popularization of smart devices and the rapid development of speech recognition technology, speech processing technology has attracted more and more public attention. In a common near-field environment (the speaker is relatively close to the microphone), the performance of speech recognition has reached over 95%, and many speech recognition and speech synthesis technologies have been commercialized. However, in the far-field environment (the speaker is far away from the microphone), there is often the influence of reverberation and various background noises, and the performance of speech recognition drops sharply. In the far-field environment, since the speaker does not need to hold a microphone or wear a microphone dev...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G10L21/0208G10L21/0216G10L25/30G10L25/03
CPCG10L21/0208G10L21/0216G10L25/03G10L25/30G10L2021/02082
Inventor 葛檬王龙标党建武
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap