Face key point tracking system and method applied to mobile device

Abstract

The invention provides a face key point tracking system and method applied to a mobile device. The system is composed of an initial face frame detection module, a face key point regression model learning module, a face key point regression calculation module, a working mode determination module and a face key point post-processing module. The face key point regression calculation module includes a detection mode and a tracking mode; an initial face frame is used as an input to carry out regression calculation of a face key point model in the detection mode; and regression calculation of a current frame key point model is carried out by using a last-frame face key point model in the tracking mode. According to the system and method provided by the invention, on the basis of the face key point positioning technology having the detection mode and the tracking mode, initial face frame detection is only carried out at a first frame, the tracking mode is employed during a follow-up positioning process, and the key point positioning of the last frame is used as the input of the current frame. Therefore, the face detection module does not need to be invoked again during the tracking process, so that the calculation time is saved and the system efficiency is improved.

Description

technical field [0001] The invention relates to a human face key point tracking system and method applied to a mobile device. Background technique [0002] Face tracking is the process of determining the trajectory and size changes of a certain face in a video or image sequence. It is the first link in the processing of dynamic face information and has important application value in human-computer intelligent interaction. [0003] In the traditional face key point positioning system, each frame of image in the video has to go through two steps of face detection and face alignment to obtain continuous face key point positioning. The face detection step That is, to obtain the initial face frame, the face pair criterion is the calculation of key points. In this way, the efficiency is low, it takes a long time, and it is easy to get stuck during the interaction process. [0004] In the face tracking of the multi-face mode, there are situations where faces increase or decrease,...

AI Technical Summary

Problems solved by technology

In this way, the efficiency is low, it takes a long time, and it is easy to get stuck during the interaction process

[0004] In the face tracking of the multi-face mode, there are situations where faces increase or decrease, so if face detection needs to be performed at the same time during the tracking process, face detection will be performed on each frame of image in the traditional method , there are problems of low efficiency and time-consuming

Images