Lip language combination method and device, electronic device and storage medium

A synthesis method and technology of electronic equipment, applied in speech analysis, speech recognition, instruments, etc., can solve the problems of low versatility and heavy workload of lip-synthesis technology, and achieve high-fidelity lip-synthesis , the effect of high accuracy

Active Publication Date: 2018-11-16
广州方硅信息技术有限公司
View PDF13 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a lip language synthesis method, device, electronic equipment and storage medium to overcome the problems of large workload and low versatility of the existing lip language synthesis technology

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Lip language combination method and device, electronic device and storage medium
  • Lip language combination method and device, electronic device and storage medium
  • Lip language combination method and device, electronic device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0046] see figure 1 , figure 1 An implementation flowchart of the lip language synthesis method provided in the embodiment of this application may include:

[0047] Step S11: performing speech recognition on the speech signal to obtain a speech recognition result, the speech recognition result including the recognized utterance and the first time interval in the uttered speech signal.

[0048] Pronunciation refers to the pinyin of Chinese characters, for exa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a lip language combination method and device, an electronic device and a storage medium. The method comprises the steps of: performing automatic speech recognition, performing phoneme recognition according to a recognition result, determining a time interval of the phonemes in the speech signals to achieve conversion of original speech signals to phonemeswith period information (namely pronunciation duration of the phonemes in the speech signals), and finally, combining a lip language through a corresponding relation of preset phonemes and a mouth shape. The method is employed to combine the lip language to improve the matching degree of the dynamic rhythms of the lip language and the rhythms of the speech, improve the mouth shape accuracy and achieve the combination of the lip language with high vividness while automatic combination of the lip language.

Description

technical field [0001] The present invention relates to the technical field of speech, and more specifically, relates to a lip language synthesis method, device, electronic equipment and storage medium. Background technique [0002] Lip language synthesis technology is a technology that uses speech information to synthesize lip movements (that is, mouth shapes) when a person expresses the speech. According to the mouth shape corresponding to the voice, various lip animations can be generated. [0003] The traditional lip-synthesis method determines the mouth shape corresponding to the voice through a purely manual calibration method, which requires the calibration person to have strong professional knowledge, which not only requires a large workload, but also has low versatility. Contents of the invention [0004] The object of the present invention is to provide a lip language synthesis method, device, electronic equipment and storage medium, to overcome the problems of ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G10L15/22G10L17/00G10L17/18G10L25/24
CPCG10L15/22G10L17/00G10L17/18G10L25/24
Inventor 庄晓滨戴长军吴丹林绪虹闫理
Owner 广州方硅信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap