3 results about "Facial reconstruction" patented technology

The invention provides a high-simulation virtual human generation method and system, and aims to gradually take a low-order virtual human as a generation source of a higher-order virtual human and carry out iterative approximation from basic image data. The technology comprises the following steps: firstly, obtaining a 2D image: step A, generating a virtual human head skeleton model file for preliminary three-dimensional face reconstruction, and then connecting the virtual human head skeleton model file to a body model bound with skeletons; b, training a neural network model for replacing the face in real time; in the step C, on one hand, the preliminary model generated in the step A is controlled through a program to realize changing actions, mouth shapes and expressions, and on the other hand, a low-order virtual human operation window is converted into virtual camera input to serve as video source input; and then performing real-time replacement with a higher simulation degree on the face by using the real-time replacement neural network model trained in the step B for the face so as to drive and form a virtual human with a higher simulation degree.

Exemplary embodiments include a computer-implemented method of training a neural network for facial reconstruction including collecting a set of 3D head scans, combining each feature of each 3D head scan with a weight to create a modified set of 3D head scans, training the neural network using the modified set of head scans, and inputting a real digital facial image into the neural network for facial reconstruction. Further exemplary embodiments include the set of 3D head scans comprising approximately a tenth or less in quantity in comparison to a quantity of the modified set of 3D head scans. The modified set of 3D head scans may comprise features found in the set of 3D head scans or the modified set of 3D head scans may consist of features found in the set of 3D head scans.