Face motion tracking method, face motion tracking system and method for enhancing reality

Abstract

The invention provides a face motion tracking method, a face motion tracking system and a method for enhancing reality. The face motion tracking method comprises the following steps of: 1) extracting face characteristic points and face contour characteristics of a video image; 2) determining the number of the face characteristic points; and 3) under the condition that the number of the face characteristic points is greater than a preset threshold value, performing motion tracking on faces in the video images by using the face characteristic points and a three-dimensional model, and under the condition that the number of the face characteristic points is smaller than or equal to the preset threshold value, performing the motion tracking by using the face contour characteristics. By the method, head motions can be accurately tracked to prevent determined face characteristic points from being lost; moreover, during real-time tracking, only a few face motion data is transmitted by a communication network, so the method is suitable for various mobile phone platforms, has low requirements on hardware conditions, and can be applied to video call interaction to improve the interest and the interaction of a call.

Description

technical field [0001] The invention relates to the field of digital video processing, in particular to the field of motion tracking in video. Background technique [0002] In recent years, the face motion tracking technology has been greatly developed, and it is necessary to track, analyze and transmit specific face targets in real time in occasions such as video conferences, distance learning, monitoring and monitoring. Many applications such as videophone, video conferencing, content-based compression and retrieval, identity authentication, and human-computer intelligent interaction are closely related to face tracking. However, the existing face tracking technology is unsatisfactory. When people move quickly, the tracking failure is often caused by the loss of facial feature points. Especially for the field of Augmented Reality (AR) technology, since the failure of tracking will inevitably lead to the failure of decoration rendering and virtual scene display, it is more...

AI Technical Summary

Problems solved by technology

However, with the movement of the head, the feature points of the face surface in the "magic mirror" may be lost. In this case, the method based on model matching is likely to cause the loss of matching, resulting in figure 1 the situation shown

Images