Male and female voice conversion method based on spectral envelope and pitch period

A technology of pitch period and spectral envelope, applied in speech synthesis, speech analysis, instruments, etc., can solve problems such as difficulty in finding actors, and achieve the effect of saving costs and saving time in movies

Inactive Publication Date: 2018-08-17
CENT SOUTH UNIV
View PDF5 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention proposes a male-female voice conversion scheme based on spectrum envelope and pitch period, which can solve the problem of personalized voice synthesis. For example, when dubbing a movie, sometimes it is difficult to find an actor who needs to dub, which can be synthesized by male-female voice conversion technology. The required dubbing effects to save time and cost for movies

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Male and female voice conversion method based on spectral envelope and pitch period
  • Male and female voice conversion method based on spectral envelope and pitch period
  • Male and female voice conversion method based on spectral envelope and pitch period

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0028] The corpus used in the preferred embodiment of the present invention is the CAISA Chinese emotion corpus, which was established by the Institute of Automation, Chinese Academy of Sciences and recorded by four professionals (two men and two women). MATLAB is used to simulate the emotional voice conversion scheme. In the simulation, male / female voice is input. Under the condition of the same speech content, the voice conversion between genders is realized, and finally the voice is output.

[0029] according to figure 1 The shown block diagram of the male and female voice conversion scheme based on the spectrum envelope and the pitch period, the specific implementation steps are as follows:

[0030] Step A. Men and women speech training stage.

[0031] The male and female voices are preprocessed first, and then their spectral envelope parameters L...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a male and female voice conversion method based on spectral envelope and the pitch period, and mainly solves the problem of personalized voice synthesis. The method comprises the steps of carrying out male and female voice training, preprocessing male and female voices, extracting the spectral envelope and the pitch period parameters of the male and female voices, establishing a matching model; converting the male and female voices, inputting the male/female frequency spectrum envelope and the pitch period parameters into a conversion model, using the parameters output by the model in voice synthesis to synthesize the voice of a target gender. Voice conversion between male and female genders can be realized for same speaking contents, and personalized voice synthesisis realized.

Description

technical field [0001] The invention belongs to the field of audio signal processing, and relates to a male and female voice conversion method based on spectrum envelope and pitch cycle. Background technique [0002] With the development of artificial intelligence technology, human life is becoming more and more enriched. Listening to concerts, playing mobile games and virtual reality have gradually become popular entertainment methods. In order to get a better auditory experience, people have higher and higher requirements for voice. . The rapid development of science and technology has made the audio industry closely integrated with human life, in which voice conversion technology plays an important role, and now voice is widely used in daily life, such as mobile phone voice assistants, smart home robots, smart voice-activated switches, etc. . As human beings have higher and higher requirements for voice, voice conversion technology is becoming more and more important, a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G10L13/02G10L25/30G10L25/18G10L25/03
CPCG10L13/02G10L25/03G10L25/18G10L25/30
Inventor 陈明义杨婧
Owner CENT SOUTH UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap