Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method for modeling non-linear three-dimensional human face based on single sheet image

A technology of 3D face and single image, which is applied in the field of nonlinear 3D face modeling, can solve the problems such as difficult transfer of animation, and achieve the goal of avoiding complexity and tediousness, good scalability, good real-time and scalability Effect

Inactive Publication Date: 2008-11-12
ZHEJIANG UNIV
View PDF0 Cites 47 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This approach allows for realistic and vivid animation of a specific character, but the resulting animation is difficult to transfer to other characters

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for modeling non-linear three-dimensional human face based on single sheet image
  • Method for modeling non-linear three-dimensional human face based on single sheet image
  • Method for modeling non-linear three-dimensional human face based on single sheet image

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] The nonlinear three-dimensional human face modeling method based on a single image is characterized in that it comprises the following steps:

[0053] 1) Given a face image, mark the predefined feature points;

[0054] 2) Based on the feature points and the reference model, the head pose in the image is automatically restored;

[0055] 3) According to the defined similarity function, find the local neighborhood for the face image in the three-dimensional face space;

[0056] 4) Using a neighborhood-based optimization method for 3D face reconstruction, using a radial basis function network to infer a 3D face model from a given image, the input of the radial basis function network is a two-dimensional pixel position, and the output is a three-dimensional space coordinate;

[0057] 5) Calculate the texture coordinates by extracting the image-based feature point coordinates, select the function that uses the radial basis function network to map from the three-dimensional coo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for nonlinearly constructing the three-dimension model of a human face from a single image under the support from a three-dimension human face database. A group of characteristic points are extracted first according to an input image, and then, the parameters of head gestures in the input image are automatically estimated according to an average human face model in the human face base; after the gesture is restored, a neighborhood is determined in the three-dimension human face database for a given human face image according to a similarity measuring function; wherein, the value of the neighborhood is adaptively determined through a cross verification algorithm; an individualized three-dimension human face model is synthesized through a neighborhood interpolation algorithm; finally, a texture mapping is solved through the extracted characteristic points. In the method for constructing the three-dimension model of the human face, a high-precision three-dimension human face animation can be obtained and applied to separate single image under different experimental conditions so as to synthesize the three-dimensional model, thus ensuring a sense of reality of the human face animation; meanwhile, a verbose of manual division of the human face lacune area can be avoided; the production efficiency of the human face animation is enhanced; the method is more stable and efficient relative to the iterative algorithm in the calculating process of generating the three-dimension human face model; furthermore, the generated three-dimension human face model has textural information; a high-precision three-dimension human face animation with the sense of reality can be generated in real time.

Description

technical field [0001] The invention relates to the technical field of computer three-dimensional animation, in particular to a nonlinear three-dimensional face modeling method based on a single image. Background technique [0002] The earliest work on 3D facial animation technology began in 1972. Subsequent scholars have done a lot of work in order to generate realistic and vivid 3D facial animation. However, due to the complex anatomical structure of the human face, the subtle non-rigid movements are difficult to model mathematically, and at the same time, people's sensitivity to the appearance of the human face makes this topic very difficult. At present, some progress has been made in the work of realistic 3D facial animation, which can basically be divided into the following categories: [0003] Interpolation-based methods: The earliest facial animations were based on interpolation methods. First, the animator makes some specific facial expression keyframes, and then...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T17/00G06T15/00
Inventor 庄越挺王宇杰王玉顺肖俊
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products