A method and device for positioning and tracking on corners of the eyes and mouths of human faces

Abstract

The invention discloses a method for positioning and tracking eye corners and mouth corners of a human face and a device thereof. In the invention, firstly a human face detection algorithm is adopted to obtain a position of the human face; an AAM algorithm is adopted to obtain an affined transformation coefficient for the detected human face and preliminary positions of six corner points of the eyes and the mouth on the human face; AdaBoost training models of all the corner points are combined to search the positions of candidate points in a neighborhood, so as to obtain a certain number of candidate points for each corner point; Harris corner point features of all the corner points are calculated, and the number of the candidate points of all the corner points are reduced according to certain rules; the candidate points of the corner points of the left eye, the right eye and the mouth are respectively combined into pairs; the point pairs are gradually eliminated by adopting a plurality of features, and finally an optimum result is returned. The proposal provided by the embodiment of the invention solves the problem of inaccurate positioning of the corner points of the eyes and the mouth of the human face in all kinds of gestures, and realizes the positioning of outer profiles of the eyes and the mouth of the human face, thereby providing a feasible scheme for driving human face two-dimensional and three-dimensional models.

Description

technical field [0001] The invention relates to the technical field of computer vision, in particular to a method and device for locating and tracking the corners of the eyes and mouth of a human face. Background technique [0002] Facial feature point location is the basis of face processing technologies such as face recognition and expression recognition. The performance of facial feature point location greatly affects the accuracy of face detection methods. Among all facial feature points, the positions of eyes and mouth are the most important. For general applications, these three organ locations can already meet the needs of the processing method, which can align and normalize faces of different shapes and sizes, and provide information for further processing. In addition, the six points of the left / right eye and the corner of the mouth can also be used as the premise and basis of other facial feature point positioning methods. In addition, in the field of human-compu...

AI Technical Summary

Problems solved by technology

[0004] However, the algorithm in the above-mentioned patent application also has certain limitations, and there are still many defects in the realized special effects. For example, first of all, in the above-mentioned algorithm, the positioning results of eyes and mouth are not very stable, resulting in a masked face. The mask on the face often shakes; secondly, the above algorithm does not add the tracking algorithm of the eye and mouth positioning points, resulting in a large amount of calculation; thirdly, the above algorithm cannot locate the eyes and mouth when the rotation angle of the face plane is too large, resulting in the corresponding Special effects fail

Images