Method and device for building personalized singing style spectrum synthesis model

A style and spectrum technology, applied in the field of building a personalized singing style spectrum synthesis model, can solve the problems of insufficient training singing data and inaccurate labeling, and achieve the effect of improving the personalized singing synthesis effect and reducing the difficulty

Active Publication Date: 2015-07-08
IFLYTEK CO LTD
View PDF5 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The present invention provides a method and device for constructing a personalized singing style spectrum synthesis model to solve the problems of insufficient training sin

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for building personalized singing style spectrum synthesis model
  • Method and device for building personalized singing style spectrum synthesis model
  • Method and device for building personalized singing style spectrum synthesis model

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0055] In order to enable those skilled in the art to better understand the solutions of the embodiments of the present invention, the embodiments of the present invention will be further described in detail below with reference to the accompanying drawings and implementation manners.

[0056] Considering that the fundamental frequency and the frequency spectrum are not matched, the generated speech will be unnatural, and the frequency spectrum parameters generated based on the singing synthesis model will be more natural in singing speech synthesis than the frequency spectrum parameters generated based on the reading style synthesis system. The embodiment provides a method and system for constructing a spectrum synthesis model of a personalized singing style. For the general user's singing data, including singing voice data and singing annotation data, it is difficult to obtain the problem, through the source speaker's reading style spectrum synthesis model And the reading style ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a device for building a personalized singing style spectrum synthesis model. The method comprises the following steps: training a reading style spectrum synthesis model and a singing style spectrum synthesis model of a source speaker; acquiring reading style data of a target speaker; determining the tone shift relation between the source speaker and the target speaker according to the reading style spectrum synthesis model of the source speaker and the reading style data of the target speaker; and performing model transformation on the singing style spectrum synthesis model of the source speaker according to the tone shift relation to obtain a singing style spectrum synthesis model of the target speaker. As the singing style synthesis model of the target speaker can be obtained through a small amount of reading style data of the target speaker, the difficulty in building a singing synthesis model of a common user is greatly lowered, and the personalized singing synthesis effect can be further effectively improved.

Description

technical field [0001] The invention relates to the technical field of speech synthesis, in particular to a method and device for constructing a personalized singing style spectrum synthesis model. Background technique [0002] In recent years, singing synthesis systems have been extensively researched and applied, among which parametric synthesis systems based on Hidden Markov Model (HMM) and waveform splicing synthesis systems have reached practical standards. Compared with the synthesis system based on waveform splicing, the parametric synthesis method based on HMM requires less training data and a smaller system scale, so it has better practical value. [0003] The singing synthesis system based on parametric synthesis first determines the duration parameter sequence, fundamental frequency parameter sequence, and spectrum parameter sequence of each basic synthesis unit (such as syllable, phoneme, etc.), and then uses the parametric synthesizer to obtain continuous singin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G10L13/02
Inventor 孙见青王影江源凌震华胡国平胡郁
Owner IFLYTEK CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap