Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Video-based 3D human face expression cartoon driving method

A technology of facial expressions and driving methods, applied in 3D image processing, image data processing, instruments, etc., can solve the problem of manual operation required for initialization, and achieve facial animation driving effects, good tracking results, and robust human The effect of face landmark localization

Inactive Publication Date: 2010-06-16
SICHUAN UNIV
View PDF0 Cites 65 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Compared with feature-based and motion-based methods, model-based methods use prior knowledge, as long as the training set contains the required facial feature positioning information, good search results can be obtained, but this type of method initialization requires manual operation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video-based 3D human face expression cartoon driving method
  • Video-based 3D human face expression cartoon driving method
  • Video-based 3D human face expression cartoon driving method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] The present invention will be further described below in conjunction with accompanying drawing:

[0041] Such as figure 1 As shown, the present invention mainly consists of four parts: image preprocessing; BP face detection; enhanced ASM face feature point positioning and tracking; data information conversion. In the image preprocessing module, the image quality is enhanced through light compensation, Gaussian smoothing and morphological operations of grayscale images; in the BP face detection module, the face in the video is detected by the neural network algorithm, and its position and size are returned, as The next step of facial feature point positioning provides a smaller search range to ensure real-time performance; in the video face feature point positioning and tracking module, the enhanced active shape model (ASM) algorithm and predictive meanshift algorithm are used to accurately extract faces Shape, eyes, eyebrows, mouth, nose and other feature point informa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a video-based 3D human face expression cartoon driving method, which comprises the following steps: (1) image preprocessing, namely improving the image quality through light compensation, Gaussian smoothing and morphology operation of a gray level image; (2) BP human face detection, namely detecting a human face in a video through a BP neural network algorithm, and returning the size of the position of the human face for providing a smaller search range for human face characteristic point positioning of the next step to ensure instantaneity; (3) ASM human face characteristic point positioning and tracking, namely precisely extracting characteristic point information of human face shape, eyes, eyebrows, mouth and nose through an enhanced active shape model algorithm and a predicted meanshift algorithm, and returning the definite position; and (4) data information conversion, namely converting the data information acquired in the human face characteristic point positioning and tracking step to acquire the motion information of the human face. The method can overcome the defects in the prior art, and can achieve live human face cartoon driving effect.

Description

technical field [0001] The invention relates to the technical field of animation driving, in particular to a video-based 3D facial expression animation driving method. Background technique [0002] As a special case of visual processing, face information processing has gradually become a research hotspot with the rapid development of computer technology and the promotion of commercial application requirements. It involves digital image processing, pattern recognition, artificial intelligence, physiology and psychology, etc. subject. The video-based face animation driving technology, which includes a key technology of face information processing such as face detection, tracking and feature location and extraction technology, has extremely important significance in the academic field and application field. Many aspects have a wide range of applications, such as video conferencing, online games, digital entertainment, etc. However, due to the influence of illumination, posture...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T15/70G06K9/00G06K9/62
Inventor 章毅王平安周激流郑伯川吕建成张蕾彭德中于佳丽
Owner SICHUAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com