Face key point tracking system and method applied to mobile device

A face key point and mobile device technology, applied to instruments, character and pattern recognition, computer components, etc., can solve problems such as time-consuming, low efficiency, and freezes, and achieve the effect of saving computing time and improving system efficiency

Active Publication Date: 2017-06-30
NANJING KIWI NETWORK TECH CO LTD
View PDF3 Cites 26 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In this way, the efficiency is low, it takes a long time, and it is easy to get stuck during the interaction process
[0004] In the face tracking of the multi-face mode, there are situations where faces increase or decrease, so

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Face key point tracking system and method applied to mobile device
  • Face key point tracking system and method applied to mobile device
  • Face key point tracking system and method applied to mobile device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0052] A face key point tracking system applied to mobile devices, such as figure 1 and Figure 5 , including an initial face frame detection module, a face key point regression model learning module, a face key point regression calculation module, a working mode determination module and a face key point post-processing module. Among them, the face key point regression model learning module is an offline module, which can learn the regression model offline in advance; other modules are all online modules, which are modules that must be used in the system workflow.

[0053] Initial face frame detection module: get the position of one or more faces. Specifically:

[0054] Use the face image to extract the pattern features, including color features, histogram features, Haar features, etc.; use the Adaboost algorithm to form a cascade classifier and use the above features to obtain a rough estimate of the face position; the rough estimate of the face obtained at this time Usual...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a face key point tracking system and method applied to a mobile device. The system is composed of an initial face frame detection module, a face key point regression model learning module, a face key point regression calculation module, a working mode determination module and a face key point post-processing module. The face key point regression calculation module includes a detection mode and a tracking mode; an initial face frame is used as an input to carry out regression calculation of a face key point model in the detection mode; and regression calculation of a current frame key point model is carried out by using a last-frame face key point model in the tracking mode. According to the system and method provided by the invention, on the basis of the face key point positioning technology having the detection mode and the tracking mode, initial face frame detection is only carried out at a first frame, the tracking mode is employed during a follow-up positioning process, and the key point positioning of the last frame is used as the input of the current frame. Therefore, the face detection module does not need to be invoked again during the tracking process, so that the calculation time is saved and the system efficiency is improved.

Description

technical field [0001] The invention relates to a human face key point tracking system and method applied to a mobile device. Background technique [0002] Face tracking is the process of determining the trajectory and size changes of a certain face in a video or image sequence. It is the first link in the processing of dynamic face information and has important application value in human-computer intelligent interaction. [0003] In the traditional face key point positioning system, each frame of image in the video has to go through two steps of face detection and face alignment to obtain continuous face key point positioning. The face detection step That is, to obtain the initial face frame, the face pair criterion is the calculation of key points. In this way, the efficiency is low, it takes a long time, and it is easy to get stuck during the interaction process. [0004] In the face tracking of the multi-face mode, there are situations where faces increase or decrease,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00
CPCG06V40/165G06V40/171
Inventor 罗楠杨通
Owner NANJING KIWI NETWORK TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap