Real-time facial animation method based on single video camera

A video camera and animation technology, applied in the field of real-time facial animation, to achieve the effect of easy to use, effective processing, and convenient use

Active Publication Date: 2013-05-08
ZHEJIANG UNIV
View PDF7 Cites 85 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

These methods can track the feature points of faces in images and videos to a certain extent, but because they all get two-dimensional feature points on the image, they have certain limitations in processing rotation.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time facial animation method based on single video camera
  • Real-time facial animation method based on single video camera
  • Real-time facial animation method based on single video camera

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0093] The inventor realized the implementation example of the present invention on a desktop computer equipped with an Intel Core i7 (3.5GHz) central processing unit, and a network camera providing 640×480 resolution at 30fps. In the implementation, the parameter settings mentioned in the detailed description are used to obtain the results in the accompanying drawings. In practice, it only takes less than 15 milliseconds to complete the capture, parameterization and avatar mapping of one frame on an ordinary computer.

[0094] The inventor invited some users to test a prototype system of the method. The results show that, on our current hardware configuration, the present invention can process various large-scale posture rotations and various exaggerated expressions in real time, and obtain animation effects very close to user input, which has a good user experience. At the same time, under different lighting conditions, such as offices, outdoors with direct sunlight, and ho...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a real-time facial animation method based on a single video camera. The method includes the steps of using the single video camera, tracking three-dimensional positions of facial feature points in real time, parameterizing face posture and facial expression according to the three-dimensional positions, and finally mapping parameters on a substitute so as to drive facial animation of a cartoon character. A real-time speed can be reached only with an ordinary video camera of a user without need of an advanced acquisition device. The real-time facial animation method based on the single video camera can accurately process various wide-angle facial rotations, facial shifting and various exaggerated facial expressions and can further work in the environments with different illumination and background conditions, including indoor environment and sunny outdoor environment.

Description

technical field [0001] The invention relates to real-time capture of human face movements and real-time animation technology, in particular to a real-time human face animation method based on a single video camera. Background technique [0002] The relevant research background of the present invention is briefly described as follows: [0003] 1. Face motion capture [0004] Facial expression capture is an important part of photorealistic graphics, which is widely used in movies, animations, games, online chat and education. A facial animation system based on facial motion capture is used to estimate the user's expressions and movements and map them to another target model. To achieve this goal, there are already many related technologies. Among them, in order to directly interact with the user, active sensing methods are usually used, including placing some signal sending points on the human face (Williams, L.1990. Performance driven facial animation. In Proceedings of SI...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T13/40G06T7/00
CPCG06T7/20G06K9/00G06T13/40G06T2207/30201G06T7/251G06V40/171G06V40/174G06V10/755
Inventor 周昆翁彦琳曹晨
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap