Three-dimensional head modeling method based on two images

Abstract

The invention discloses a modeling method of restoring a user three-dimensional face surface model from two images. The method comprises the following steps of: interactively adjusting the positions of pre-defined control points and matching with facial features to get an initial corresponding point set; stratifying control points according to semantics, and carrying out interpolation calculation on the deformation of all non-control vertexes from the given initial point set by utilizing a moving least square algorithm based on three-dimensional rigid changes of vertexes to get a continuous and smooth surface of a realistic three-dimensional model; calculating coordinates of enveloping cylindrical textures of the deformed model, extracting color values from an input human face image, synthesizing a texture image and sticking the texture image to the surface of the model; and generating a three-dimensional head model with the real textures. According to the modeling method disclosed by the invention, the difficulty of needing to input multiple images or needing to perform excessive complex manual interaction operation of the traditional three-dimensional modeling technology is solved, and modeling of the three-dimensional head real model based on the front and the side images with ordinary resolution can be realized.

Description

technical field [0001] The invention belongs to the technical fields of computer vision and computer graphics, and in particular relates to a technology of three-dimensional head shape and texture modeling based on two front and side images. Background technique [0002] A large number of two-dimensional face images can be acquired by using a digital camera to shoot at different angles. If the three-dimensional face model can be recovered from these images, it will be widely used in fields such as virtual video conferencing, online role games and 3D movies. However, due to the loss of the three-dimensional structure of the image, there are many technical difficulties in completely reconstructing the three-dimensional face model and structural details from the input image. In the field of computer graphics and computer vision, this is a problem that has been studied for many years. According to the technical means and the number of image samples required, the existing method...

AI Technical Summary

Problems solved by technology

[0005] To sum up, the existing 3D head modeling technology is far from mature, and it is not possible to restore the 3D face model and its details from a given small number of images without or with only a small amount of manual interaction.

How to fully reconstruct the shape and details of an arbitrary user's head from no more than two images without prior training samples remains a challenging problem

Images