Unlock instant, AI-driven research and patent intelligence for your innovation.

Speech visualization system and speech visualization method

A technology of speech and speech data, applied in speech analysis, instruments, etc., can solve the problem of not being able to simulate the real movements of the speaker's internal vocal organs.

Active Publication Date: 2009-07-22
SHENZHEN INST OF ADVANCED TECH
View PDF0 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In view of this, it is necessary to solve the problem that the biological simulation technology cannot simulate the real action of the speaker's internal vocal organs, and provide a real Voice Visualization System for Actions

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Speech visualization system and speech visualization method
  • Speech visualization system and speech visualization method
  • Speech visualization system and speech visualization method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] figure 1 is a schematic diagram of the speech visualization system. The speech visualization system 100 includes a speaker movement data collection module 101, a first speech data collection module 102, a first speech recognition module 103, a pronunciation organ movement data collection module 104, a three-dimensional speaker avatar static modeling module 105, and a motion control parameter transformation Module 106 , monophone pronunciation organ movement simulation module 107 , second speech recognition module 109 , continuous pronunciation movement simulation module 110 and display module 111 .

[0022] The speaker motion data collection module 101 is used to collect speaker motion data. Speaker motion data can be two-dimensional data or three-dimensional data. The speaker's motion data can be obtained by videotaping the speaker's frontal and orthogonal sides, and performing X-ray imaging (or nuclear magnetic resonance imaging) on ​​the speaker. Or use motion cap...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a voice visualization system and a voice visualization method. The voice visualization system comprises a speaker movement data collecting module, at least a voice data collecting module, at least a voice recognition module, a voice organ movement data collecting module, a 3D speaker head portrait static modeling module, a movement control parameter transformation module, a mono-phone voice organ movement analog module, a continuous pronunciation movement analog module and a display module. The voice visualization method comprises the following steps: the speaker movement data and voice data of the speaker are simultaneously collected; the voice data is processed; a voice organ movement database is established; a 3D speaker head portrait static 3D model is established; a corrected voice organ movement database is established; coordinated deformation simulation of all voice organs of each mono-phone is realized; voice information of the speaker is received; the 3D speaker head portrait pronunciation movement is simulated; 3D visualization information of the 3D speaker head portrait pronunciation movement is displayed.

Description

technical field [0001] The invention relates to a speech visualization system and a speech visualization method. Background technique [0002] At present, biosimulation technology mainly simulates the appearance and behavior characteristics of organisms, and the simulation of internal organs of organisms is limited to reproducing their static states. Its disadvantage is that it cannot simulate the real action of the speaker's internal vocal organs. Contents of the invention [0003] In view of this, it is necessary to provide a speech visualization system that can simulate the real movements of the speaker's internal vocal organs to solve the problem that biological simulation technology cannot simulate the real movements of the speaker's internal vocal organs. [0004] A speech visualization system, comprising a speaker movement data collection module, at least one speech data collection module, at least one speech recognition module, a pronunciation organ movement data ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G10L21/06G10L21/10
Inventor 王岚陈辉欧阳建军
Owner SHENZHEN INST OF ADVANCED TECH