Voice mouth shape synchronization method and device, electronic equipment and storage medium

A mouth shape and voice technology, applied in the computer field, can solve the problems of large resource occupation and high production time and cost

Pending Publication Date: 2021-02-05
NETEASE (HANGZHOU) NETWORK CO LTD
View PDF8 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the existing technology, in order to achieve the lip-sync effect of voice, art needs to produce all the lip animations corresponding to the voice, which not only takes up a lot of resources, but also costs a lot of production time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Voice mouth shape synchronization method and device, electronic equipment and storage medium
  • Voice mouth shape synchronization method and device, electronic equipment and storage medium
  • Voice mouth shape synchronization method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of the specific details being omitted, or other methods, components, devices, steps, etc. may be adopted. In other instances, well-known technical solution...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a voice mouth shape synchronization method and device, a storage medium and electronic equipment, and relates to the technical field of computers. The method comprises the steps: acquiring a basic mouth shape action image, extracting designated feature points of the basic mouth shape action image, obtaining a basic mouth shape action model through adjustment of a grid deformer based on the designated feature points, and obtaining corresponding vertex information of the basic mouth shape action model in the grid deformer; and based on the vertex information of the basic mouth shape action model, performing calculation by utilizing first mouth shape animation data generated by analyzing target voice to obtain second mouth shape animation data synchronous with the target voice. When 2D role voice mouth shape synchronous animation is manufactured, the resource occupation is small, the manufacturing time cost is low, and the animation effect is more vivid.

Description

technical field [0001] The present disclosure relates to the field of computer technology, and in particular, to a voice lip-sync method, a voice-lip sync device, a computer-readable storage medium, and electronic equipment. Background technique [0002] Nowadays, with the improvement of animation production level, more and more games have added plot dialogue animation. Moreover, in order to improve the user's game experience and make the lip animation effect of the game character more realistic, it is necessary to realize the voice lip-sync of the game character. [0003] In the prior art, in order to achieve the effect of voice-lip synchronization, art needs to produce all voice-corresponding lip-motion animations, which not only takes up a lot of resources, but also costs a lot of production time. [0004] Therefore, it is very necessary to provide a character voice lip-sync method with less resource occupation, lower production time cost and more realistic animation eff...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G10L15/02G10L15/04G10L15/06G10L15/14G10L15/16G10L15/22G10L15/25G10L25/24G10L21/10G06T13/80G06N3/04G06N3/08
CPCG10L15/02G10L15/04G10L15/063G10L15/16G10L15/144G10L25/24G10L15/22G10L21/10G06T13/80G06N3/084G10L2015/025G10L2021/105G06N3/045
Inventor 童能仕卢德辉
Owner NETEASE (HANGZHOU) NETWORK CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap