Voice conversion method and device and electronic equipment

A voice conversion and voice technology, applied in voice analysis, voice synthesis, voice recognition, etc., can solve the problems of long waiting time for voice conversion, high requirements, poor flexibility, etc.

Pending Publication Date: 2021-01-22
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF10 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, the voice conversion method in the related art requires the user to record voice clips in advance, and perform model training and update according to the user's voice clips, and then perform voice conversion according to the updated model. This method has high requirements for the user's voice recording. The model needs to be updated before each voice conversion, the waiting time for voice conversion is long, and the flexibility is poor

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Voice conversion method and device and electronic equipment
  • Voice conversion method and device and electronic equipment
  • Voice conversion method and device and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] Exemplary embodiments of the present application are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present application to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0019] figure 1 is a schematic flowchart of the speech conversion method according to the first embodiment of the present application.

[0020] Such as figure 1 As shown, the speech conversion method of the first embodiment of the present application includes:

[0021] S101. Acquire a source voice of a first user and a reference voice of a second user.

[0022] I...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a voice conversion method and a device and electronic equipment, and relates to the technical field of voice conversion, voice interaction, natural language processing and deeplearning. According to the specific implementation scheme, the method comprises the followings steps: acquiring source voice of a first user and reference voice of a second user; extracting first voice content information and a first acoustic feature from the source voice; extracting a second acoustic feature from the reference voice; inputting the first voice content information, the first acoustic feature and the second acoustic feature into a pre-trained voice conversion model to obtain a reconstructed third acoustic feature, and obtaining the pre-trained voice conversion model according to voice training of a third user; and synthesizing the target speech according to the third acoustic feature. According to the method, the first voice content information and the first acoustic feature of the source voice and the second acoustic feature of the reference voice are input into the pre-trained voice conversion model, and the target voice is obtained and synthesized according to the reconstructed third acoustic feature, so that the waiting time of voice conversion can be shortened.

Description

technical field [0001] The present application relates to the technical fields of voice conversion, voice interaction, natural language processing, and deep learning in the field of computer technology, and in particular to a voice conversion method, device, electronic equipment and storage medium. Background technique [0002] The voice conversion method can convert a piece of voice of a user into a piece of voice with the timbre of the target user, so as to realize the imitation of the timbre of the target user. At present, the voice conversion method in the related art requires the user to record voice clips in advance, and perform model training and update according to the user's voice clips, and then perform voice conversion according to the updated model. This method has high requirements for the user's voice recording. The model needs to be updated before each speech conversion, and the waiting time for speech conversion is long and the flexibility is poor. Contents...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G10L13/02G10L13/08G10L21/007G10L25/03G10L25/30
CPCG10L13/02G10L13/08G10L21/007G10L25/03G10L25/30G10L2021/0135G10L15/14G10L15/02G10L21/003G06N3/08G10L13/033G10L21/013G10L2015/025
Inventor 王锡磊王文富孙涛
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap