Method for transferring facial expression and device for transferring facial expression

Abstract

The invention discloses a method and a device for transferring facial expressions. The method comprises acquiring a current frame color image and detecting a face thereof, calculating positions of a plurality of preset key points of the face of the current frame color image; calculating a projection matrix according to the positions of a plurality of preset key points of a human face of a currentframe color image and the positions of a plurality of preset key points of a preset deformation model, using the projection matrix, the neutral expression and expression base corresponding to the preset key points of the deformation model being projected into the two-dimensional space to obtain the projection results.; according to the projection results and the positions of some preset key pointsof the face in the color image of the current frame, a set of linear equations being constructed, and the weight coefficients of expression bases being calculated, so that the real-time expression ofthe face can be obtained; according to the real-time facial expression driven cartoon model, the facial expression migration is completed. vivid transfer of people's various expressions can be realized in any posture.

Description

technical field [0001] The invention relates to the technical field of facial expression transfer, in particular to a method for transferring human facial expression and a device for transferring human facial expression. Background technique [0002] The emergence of AR technology has provided a powerful means for the expansion of human intelligence and brought great fun to people's lives. The entertainment-oriented AR face technology can touch people's daily life more conveniently and has wonderful interactions. experience. [0003] The development of science and technology, advanced technology, and the emergence of new equipment are constantly changing people's lives. In recent years, AR technology has begun to enter people's field of vision, expanding people's perspective on the world and enriching people's lives. AR technology is Through computer technology, the real world and the virtual world are superimposed together, which can be recognized by people's senses, to ac...

AI Technical Summary

Problems solved by technology

[0005] However, with regard to the migration technology of facial expressions, the domestic ones are not mature enough. At present, this technology can mainly be reflected in some special effect apps. From the experience point of view, there are mainly the following shortcomings: (1) The expressions are not rich enough, only It can show about 4 kinds of expressions, such as anger, anger, surprise and other expressions cannot be transferred perfectly; (2) The effect of expression transfer is relatively rigid. In reality, when people make an expression, the rest of the muscles will also be involved, but it has been Some effects only transfer part of the muscles, which are not so realistic; (3) In a large posture, the expression transfer effect is unstable, and the whole head shakes, which affects the experience effect

Images