Dilated causal convolution generative adversarial network end-to-end bone conduction speech blind enhancement method

A network-side, convolutional technology, applied in speech analysis, instruments, etc., can solve problems such as poor auditory perception and lack of high-frequency components of bone conduction speech, and achieve the effects of increasing computing costs, good reconstruction, and easy processing.

Active Publication Date: 2019-08-16
TIANJIN UNIV
View PDF6 Cites 30 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] In order to overcome the deficiencies in the prior art, the present invention aims to propose an end-to-end bone conduction speech enhancement algorithm based on the hole causal convolution generation confrontation network, and the proposed system uses end-to-end (ie waveform input and waveform output) Speech enhancement is carried out by means of training, the best network model parameters are obtained through training, and then the trained model is used to enhance bone conduction speech, so as to solve the problems of lack of high-frequency components of bone conduction speech, poor auditory perception and communication under strong noise background

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dilated causal convolution generative adversarial network end-to-end bone conduction speech blind enhancement method
  • Dilated causal convolution generative adversarial network end-to-end bone conduction speech blind enhancement method
  • Dilated causal convolution generative adversarial network end-to-end bone conduction speech blind enhancement method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The technical solution to achieve the object of the present invention is: a hole causal convolution-based generative adversarial network structure for end-to-end speech enhancement, which is different from the existing large amplitude spectrum (such as logarithmic power spectrum (LPS)) that only processes. Different from most enhancement methods, it directly takes the bone conduction raw audio sampling points as the input data and the pure air conduction raw audio as the training output target, and constructs and trains the atrous causal convolution generative adversarial enhancement network.

[0036] The hole causal convolution generative adversarial network includes a generator and a discriminator. The generator adopts hole causal convolution to perform deep feature extraction and feature transformation on the input data of the network, and output enhanced samples; the discriminator is the input The original audio data and the enhanced voice samples generated by the ge...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the field of artificial intelligence and medical rehabilitation instruments, aims to provide an end-to-end bone conduction speech enhancement method, and solves the problems of the absence of high-frequency components of bone conduction speech, poor auditory perception, communication under the background of strong noise and the like. According to the dilated causal convolution generative adversarial network end-to-end bone conduction speech blind enhancement method, a bone conduction original audio sampling point is taken as input data, a pure air conduction original audio is taken as an output target of training, bone conduction speech is input into a trained dilated causal convolution generative adversarial network, the dilated causal convolution generative adversarial network comprises a generator and a discriminator, the generator adopts dilated causal convolution, and an enhanced sample is output; the discriminator inputs original audio data and the enhanced speech sample generated by the generator, and a convolution layer in the discriminator is used for extracting deep nonlinear features, thereby performing deep similarity judgment of the sample. Thedilated causal convolution generative adversarial network end-to-end bone conduction speech blind enhancement method is mainly applied to the design and manufacturing occasion of bone conduction speech enhancement equipment.

Description

technical field [0001] The invention relates to the field of artificial intelligence, in particular to a training method and system for an end-to-end speech enhancement model. Specifically, it involves an end-to-end bone-conducted speech blind enhancement method for atrous causal convolutional generative adversarial networks. Background technique [0002] The difference in the way Bone Conducted Microphone (BCM) and traditional Air Conducted Microphone (ACM) transmit sound is that the sound collected by BCM is not transmitted through the air, but collected from human bones by a highly sensitive vibration sensor. or tissue vibrations, which are then converted into audio signals. Its advantage is that the noise is shielded from the sound source, and the transmission of ambient noise at both ends of the communication system is prevented from the source, so even in a strong noise environment, useful signals can be clearly transmitted. Although the bone conduction (AC, Air Cond...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G10L21/02G10L25/30
CPCG10L21/02G10L25/30
Inventor 魏建国胡宏周何宇清路文焕
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products