Human face critical organ contour characteristic points positioning and tracking method and device

A technology for key organs and outer contours, applied in instruments, character and pattern recognition, computer components, etc., can solve problems such as the inability to accurately locate the outer contours of human faces and eyes, and the inability to accurately track outer contour points

CN101339606AActive Publication Date: 2009-01-07BEIJING VIMICRO ARTIFICIAL INTELLIGENCE CHIP TECH CO LTD
1 Cites 37 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Publication Date
2009-01-07

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a method for positioning and tracking outer contour feature points of key face organs and a device thereof, comprising the following steps: first, the positions of canthi points and angulus oris points on the face are obtained; the medial axis of the eyes and the mouth is identified based on the positions; the outer contour feature points of the eyes and eyebrows are identified on the medial axis of the eyes, and the outer contour feature points of the mouth are identified on the medial axis of the mouth. Consistent positioning and tracking of outer contour feature points of key face organs are conducted on such a basis. The technical proposal provided by the embodiment of the invention solves the problem of inaccurate positioning of outer contour feature points of eyes, mouth and eyebrows when people makes various faces; based on the positioning of the feature points, the existing two-dimensional and three-dimensional face models can be real-time driven, and face expressions and motions such as frowning, blinking and mouth opening of people before a camera can be real-time simulated, thus creating various real and vivid face animations.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to the technical field of computer image processing, in particular to a method and device for locating and tracking feature points on the outer contours of key organs of a human face. Background technique

[0002] At present, in the face detection and localization technology, it can be roughly divided into organ-based detection and localization methods and template-based detection and localization methods. The organ-based method regards the human face as a combination of salient organs, first extracts some important organs: eyes, nose, lips, etc., and then detects the face through the position of the organs and the geometric relationship between them. The performance of face key organ localization largely affects the accuracy of face detection methods.

[0003] Traditional methods based on Active Appearance Models (AAM, Active Appearance Models) and Active Shape Models (ASM, Active Shape Models) generally use training models to l...

Examples

Embodiment Construction

[0044]Systems such as 2D and 3D face pose estimation and face animation synthesis based on input video can synthesize face eyes and mouth in real time, and simulate various movements of mouth and eyes on the face model. However, the system must be based on the precise positioning of the outer contours of the face's eyes and mouth. It is possible to obtain stable and vivid two-dimensional and three-dimensional face synthesis results, and generate realistic facial animation.

[0045] The embodiment of the present invention proposes a method and device for locating and tracking key facial organ outline feature points on the basis of the positioning and tracking results of the corners of the eyes and the corners of the mouth. The method and device can be used to locate the feature points of the human face's eyes, eyebrows and mouth outline in real time from the video image input by the camera equipment, for example, 20 feature points can be located, such as figure 1 shown, and co...