Unlock instant, AI-driven research and patent intelligence for your innovation.

Single-channel Speech Separation Algorithm Based on Deep Neural Network

A deep neural network and speech separation technology, applied in speech analysis, speech recognition, instruments, etc., can solve problems such as time-consuming, ignoring the output joint relationship, and the impact of speech separation performance, so as to reduce distortion rate, high separation efficiency, and improve intelligibility effect

Active Publication Date: 2022-02-11
NANJING UNIV OF POSTS & TELECOMM
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When using a single-output DNN to separate mixed voices, only one voice can be separated at a time. When using this method to separate multiple voices, it takes a long time; the traditional method based on a multi-output deep neural network can separate multiple voices at the same time. However, for this reason, the output mapped by the multi-output DNN is not as targeted as the single-output DNN, and the separation effect is worse than that of the single-output DNN.
Both of the above two deep neural networks need to be trained by a loss function. The basic loss function used by the traditional dual-output DNN is only used to map the relationship between input and output, but ignores the joint relationship between outputs, and this joint relation has a large impact on the final speech separation performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Single-channel Speech Separation Algorithm Based on Deep Neural Network
  • Single-channel Speech Separation Algorithm Based on Deep Neural Network
  • Single-channel Speech Separation Algorithm Based on Deep Neural Network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] In order to make the objects, technical solutions, and advantages of the present invention, the present invention will be described in detail below with reference to the accompanying drawings and specific embodiments.

[0046] like figure 1 As shown, the present invention provides a single-pass speech separation algorithm based on a depth neural network, which mainly includes the following steps:

[0047] Step 1: Preprocessing the training language samples and extracts its characteristic information;

[0048] Step 2: Training the depth neural network using the loss function to obtain a depth neural network model;

[0049] Step 3: Preprocessing the sample to be tested, extracting its feature information, and performing speech separation by training after training, then the separation result is obtained by speech.

[0050] The following will be described in detail below.

[0051] Among them, step 1 specifically includes:

[0052] Step 11: Sampling the time domain signal of th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a single-channel speech separation algorithm based on a deep neural network, which mainly includes the following steps: preprocessing the training speech samples and extracting their feature information; using a loss function to train the deep neural network to obtain a deep neural network Network model: Preprocess the speech sample to be tested, extract its feature information, and perform speech separation through the trained deep neural network model, and then obtain the separation result through speech reconstruction. The present invention uses the nonlinear relationship between input and output to train the deep neural network. Compared with the traditional separation method based on the single-output deep neural network, it fully excavates the joint relationship between the outputs, and the separation efficiency is high. Separating the two source speech signals effectively reduces the distortion rate of the speech and improves the intelligibility of the separated speech at the same time.

Description

Technical field [0001] The present invention relates to a single pass speech separation algorithm based on a depth neural network, belonging to the field of speech separation. Background technique [0002] Single Channel Speech Separation, SCSS is a process of recovering multiple speech from one-dimensional mixed speech. Single-channel speech separation techniques are widely used in voice enhancement, speech recognition pretreatment, hearing aid or smart home. In these areas, usually the sensor receives a mixed voice from a microphone, and the human ears can easily obtain useful information from this mixed speech, and for the computer, it is difficult to accurately get the desired voice. Therefore, it is very important to accurately and efficiently get a very important practical meaning. [0003] Deep Neural Network (DNN) has powerful data mining capabilities, in the field of speech separation, which is mainly used to simulate nonlinear relationships between input features and ou...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G10L21/0272G10L15/02G10L15/06G10L15/16
CPCG10L21/0272G10L15/02G10L15/063G10L15/16
Inventor 孙林慧朱阁傅升邹博
Owner NANJING UNIV OF POSTS & TELECOMM