Real-time three-dimensional eyelid reconstruction method and device

Abstract

The invention discloses a real-time three-dimensional eyelid reconstruction method and device. The method comprises the steps that the pixel points of each channel of a four-channel boundary map including semantic information are fitted into a polynomial curve with the grayscale value acting as the weight; the three-dimensional characteristic vertexes corresponding to the four boundaries includingthe semantic information of the image on a linear three-dimensional eyelid model are defined and the corresponding relation between the three-dimensional characteristic vertexes and the two-dimensional characteristic points on the corresponding boundaries of the image is determined; a difference function is determined by the distance between the projection of the three-dimensional characteristicvertexes and the two-dimensional characteristic points, and the optimal weight coefficient of the two sets of linear three-dimensional eyelid models is solved; and the three-dimensional reconstructionresult of the eyelids is integrated in the face reconstruction result. According to the method, the four boundaries including the semantic information of the eye areas can be utilized, and real-timethree-dimensional eyelid reconstruction can be realized by optimizing the weight coefficient of the two sets of linear three-dimensional eyelid models so that the overall sense of reality of the three-dimensional facial animation can be enhanced.

Description

technical field [0001] The invention relates to the technical fields of computer graphics and computer vision, in particular to a real-time three-dimensional eyelid reconstruction method and device. Background technique [0002] In the field of computer graphics and computer vision, generating vivid and realistic facial model animation has always been an important and challenging problem. The human face is the most important part of the human body, and the eyes are called the window of the soul. The subtle movements of the skin in the eye area express the rich emotions of human beings. Therefore, real-time 3D reconstruction of eyelids can greatly enhance the realism of facial model animation, and has extremely high scientific research and application value. [0003] However, the area of ​​the eye area is very small, and the movement of the eyelids includes skin occlusion and folds. It is usually very difficult to directly model the shape and movement of the eye area; some a...

AI Technical Summary

Problems solved by technology

[0003] However, the area of ​​the eye area is very small, and the movement of the eyelids includes skin occlusion and folds. It is usually very difficult to directly model the shape and movement of the eye area; some accurate modeling methods (such as from shadow Shape recovery method) can accurately describe the shape of the skin in the eye area, but these methods are difficult to meet the real-time requirements of 3D eyelid reconstruction, which needs to be solved

Images