Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Mixed sound signal separation method and device, electronic equipment and readable medium

A separation method and sound signal technology, applied in speech analysis, speech recognition, instruments, etc., can solve the problems of doping sound source signal, separation of sound source signal cleanness, influence, etc., and achieve the effect of improving training efficiency

Active Publication Date: 2019-05-24
BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
View PDF7 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although the sound source signal obtained by this end-to-end model separation has a high signal-to-noise ratio, it is almost impossible for the separated sound source signal to be clean, and it will be more or less doped with other residual sound source signals
Although these residual interferences are weak, they have a very serious impact on subsequent steps such as lyrics segmentation and song evaluation.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mixed sound signal separation method and device, electronic equipment and readable medium
  • Mixed sound signal separation method and device, electronic equipment and readable medium
  • Mixed sound signal separation method and device, electronic equipment and readable medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0070] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present application as recited in the appended claims.

[0071] In this paper, the vocal training samples, the vocal verification samples and the vocal sound signals are all pure human voice signals (or data), and accordingly, the accompaniment sound training samples, the accompaniment sound verification samples and the accompaniment sound signals are pure The signal (or data) of the accompaniment sound. Also, naming the audio data as trainin...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a mixed sound signal separation method and device, electronic equipment and a readable medium. The method includes: extracting mixed sound characteristic data from mixed soundsignals; inputting the mixed sound characteristic data into a mixed sound coding module to obtain a first hidden variable and a second hidden variable, wherein the first hidden variable represents human voice characteristics, and the second hidden variable represents accompany sound characteristics; inputting the first hidden variable and the second hidden variable into a human voice decoding model and an accompany sound decoding model to obtain human voice characteristic data and accompany sound characteristic data; acquiring human voice and accompany sound on the basis of the human voice characteristic data and accompany sound characteristic data. The human voice and the accompany sound obtained according to the method is low in signal-to-noise ratio.

Description

technical field [0001] The present application belongs to the application field of computer software, in particular to a separation method, device, electronic equipment and readable medium of a mixed sound signal. Background technique [0002] General pop music is composed of vocals and accompaniment superimposed and mixed. It is a challenging task to separate the mixed music into vocals and accompaniment (accompaniment separation). Acoustic partner separation plays an important role in music editing and music retrieval. Improvements in the performance of the Acoustic Separation model can greatly improve the performance of subsequent processing pipelines. [0003] The current mainstream sound companion separation model is an end-to-end deterministic model, which calculates the mask (mask) of each sound source in the time-frequency diagram, and then multiplies the mask by the time-frequency diagram of the mixed sound to obtain the time-frequency of the separated sound sourc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G10L21/0272G10L25/30G10L25/48
CPCG10L25/30G10L21/0272G10L15/02G10L15/20G10L17/20
Inventor 张宁李岩姜涛
Owner BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products