Supercharge Your Innovation With Domain-Expert AI Agents!

Method and system for converting voice into song

A technology that converts songs into songs, applied in speech analysis, instruments, electro-acoustic musical instruments, etc., can solve problems such as reducing user experience, song sound distortion, unnaturalness, etc., achieving remarkable efficiency and versatility, and improving the effect of sound quality

Active Publication Date: 2021-02-23
北京中科深智科技有限公司
View PDF13 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, the song sound generated by the song synthesis method in the prior art is distorted and unnatural, which greatly reduces the user experience.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for converting voice into song
  • Method and system for converting voice into song

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] The technical solutions of the present invention are further described below with reference to the accompanying drawings and through specific embodiments.

[0024] Among them, the accompanying drawings are only used for exemplary description, and they are only schematic diagrams, not physical drawings, and should not be construed as restrictions on this patent; in order to better illustrate the embodiments of the present invention, some parts of the accompanying drawings will be omitted, The enlargement or reduction does not represent the size of the actual product; it is understandable to those skilled in the art that some well-known structures and their descriptions in the accompanying drawings may be omitted.

[0025] The method for converting speech into songs provided by an embodiment of the present invention, such as figure 1 shown, including the following:

[0026] Process the speech signal and convert it into a mel spectrogram;

[0027] F0 contours are extract...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for converting voice into a song, wherein the method comprises the following steps: processing a voice signal, and converting the voice signal into a mel spectrogram;extracting F0 contours from different sound sources through a sound melody extractor; stretching the time of the mel spectrogram to the same length as the F0 outline, and respectively encoding the melspectrogram and the F0 outline through two encoders; associating the encoded mel spectrogram with the F0 outline through a decoder, and generating a song spectrogram; and processing the song spectrogram through the MelGAN vocoder, so as to improve the tone quality of the output song. The invention further discloses a system for converting the voice into the song. Song tone quality can be effectively improved, and user experience is improved.

Description

technical field [0001] The invention relates to the technical field of speech signal processing, in particular to a method and system for converting speech into songs. Background technique [0002] At present, there are application requirements for song synthesis in entertainment, karaoke, and music production. Song synthesis is the creation of natural-looking songs under certain conditions, such as lyrics, pitch tags, or reference audio. The reference audio can be a singing passage of one person, and the task is to convert the timbre of the singing passage into the timbre of another person. Reference audio can also be a piece of someone's speech whose task is to transform it into a singing passage with the same timbre identity and linguistic content, without reference to its underlying phoneme sequence. [0003] However, the sound of songs generated by the method for synthesizing songs in the prior art is distorted and unnatural, which greatly reduces the user experience....

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G10H1/00G10L21/007G10L25/24G10L25/03
CPCG10H1/0025G10H2210/101G10L21/007G10L25/03G10L25/24
Inventor 不公告发明人
Owner 北京中科深智科技有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com