Method and device for controlling mouth shape change of three-dimensional virtual portrait

A 3D virtual and mouth-shaping technology, applied in the computer field, can solve the problems of large manpower, consumption, and inability to achieve real-time performance

Pending Publication Date: 2019-09-27
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF8 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method is very dependent on the professional skills of technicians, manual work frame by frame consumes a lot of manpower, and this method cannot achieve real-time performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for controlling mouth shape change of three-dimensional virtual portrait
  • Method and device for controlling mouth shape change of three-dimensional virtual portrait
  • Method and device for controlling mouth shape change of three-dimensional virtual portrait

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] The present disclosure will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain related inventions, rather than to limit the invention. It should also be noted that, for the convenience of description, only the parts related to the related invention are shown in the drawings.

[0031] It should be noted that, in the case of no conflict, the embodiments in the present disclosure and the features in the embodiments can be combined with each other. The present disclosure will be described in detail below with reference to the accompanying drawings and embodiments.

[0032] figure 1 An exemplary system architecture 100 is shown in which the method for controlling lip-shape changes of a three-dimensional virtual portrait or the device for controlling lip-shape changes of a three-dimensional virtual portrait according to embodiments o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a method and device for controlling the mouth shape change of a three-dimensional virtual portrait, and relates to the field of cloud computing. A specific embodiment of the method comprises the steps of obtaining a to-be-played voice; sliding a preset time window in the to-be-played voice according to a preset step length to obtain at least one voice segment; generating a mouth shape control parameter sequence for the to-be-played voice based on the at least one voice segment; and controlling the mouth shape of a preset three-dimensional virtual portrait to change based on the mouth shape control parameter sequence in response to playing of the to-be-played voice. According to the embodiment, the mouth shape control parameter sequence is automatically generated based on the to-be-played voice, so that the voice and the three-dimensional virtual portrait with the synchronously changed mouth shape are efficiently rendered.

Description

technical field [0001] The embodiments of the present disclosure relate to the field of computer technology, and in particular to a method and a device for controlling lip-shape changes of a three-dimensional virtual portrait. Background technique [0002] 3D virtual portrait speech lip synchronization has always been a research hotspot, and has a wide range of applications. Common application fields include film and television animation, game entertainment and so on. Traditional 3D virtual portrait voice lip synchronization technology usually requires professional technicians to manually set the key frames of the 3D virtual portrait according to the given voice clips, and adjust the mouth shape for the 3D virtual portrait in these key frames. The mouth shape of the three-dimensional virtual portrait in the transition frame between the key frames is automatically generated by the animation engine. For example, it can be automatically generated by animation engines such as ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T13/40G06N3/04G10L25/48
CPCG06T13/40G10L25/48G06N3/049G06N3/044G10L21/10G10L2021/105G10L2015/025G06N3/045G10L15/08G06N3/04G06F3/167G06T13/20G10L13/08G10L15/22G10L2015/223
Inventor 陈超王建祥
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products