Virtual human face animation generation method and device

An animation and face technology, applied in the field of virtual face animation generation, can solve the problems of narrow application scope, low realism of virtual face animation, high cost, and achieve the effect of expanding application scope, improving authenticity and promoting development.

Active Publication Date: 2017-05-10
TCL CORPORATION
View PDF6 Cites 67 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Embodiments of the present invention provide a method and device for generating virtual human face animation, aiming to solve the problems of low realism, high cost and narrow application range of current virtual human face animation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Virtual human face animation generation method and device
  • Virtual human face animation generation method and device
  • Virtual human face animation generation method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0028] In the embodiment of the present invention, the virtual facial animation can be displayed on terminals such as computers, notebook computers, mobile phones, tablet computers, and VR (Virtual Reality) glasses. According to the virtual personal assistant (VPA) application provided by the terminal, through natural language processing and semantic analysis technology, it can accept the voice request sent by the user, answer the question with the specific person displayed in the video screen, and provide intelligent recommendation, just like There is a face-to-face "real person" interacting with ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention is suitable for the technical field of artificial intelligence and provides a virtual human face animation generation method and device. The method comprises the following steps: an input text is converted into a voice signal; based on a position at which a silent frame occurs in the voice signal, the input text is subjected to phrasing operation, and a plurality of short sentences are obtained; for each short sentence, a head swinging movement in a virtual human face animation is generated, each short sentence is mapped to at least one lip shape, head swinging movements corresponding to all short sentences are combined with lip shapes, and therefore virtual human face animations corresponding to all the short sentences can be generated. According to the method and device disclosed in the invention, the virtual human face animations are generated based on combination of the text and voice, the head swinging movements and the lip shapes are generated and combined, visual sense close to reality is provided for users, a phenomenon that the obtained virtual human face animations only comprise lip shape information can be prevented, truthfulness of the virtual human face animations can be improved, dependence on expensive and complex equipment can be prevented, costs can be lowered, and an application scope of the virtual human face animations can be expanded.

Description

technical field [0001] The invention belongs to the technical field of artificial intelligence, and in particular relates to a method and a device for generating virtual human face animation. Background technique [0002] With the advancement of artificial intelligence technology, virtual personal assistants such as Apple Siri, Google Assistant, and Microsoft Cortana have gradually participated in people's lives. At present, most virtual personal assistants can only use voice to communicate with users without a specific visual animation image. Therefore, there is still a certain difference from the communication between people in the real world. For TVs, personal computers, mobile phones and other devices that can provide audio and video output, creating a virtual personal assistant that can be seen and heard will be an important trend in the development of artificial intelligence technology. [0003] Existing virtual facial animations are mainly generated based on speech r...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G10L21/10G10L13/08G10L13/10G10L15/25G06T13/40
CPCG06T13/40G10L13/08G10L13/10G10L15/25G10L21/10G10L2021/105
Inventor 李松南
Owner TCL CORPORATION
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products