Face key point detection method and device based on deep reinforcement learning

A face key point and reinforcement learning technology, which is applied in the field of face key point detection based on deep reinforcement learning, can solve problems such as error accumulation and result deviation, and achieve the goal of maximizing shape evaluation scores, improving accuracy and reliability Effect

Active Publication Date: 2018-08-24
TSINGHUA UNIV
View PDF5 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This cascading approach leads to the accumulation of errors bet

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Face key point detection method and device based on deep reinforcement learning
  • Face key point detection method and device based on deep reinforcement learning
  • Face key point detection method and device based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary and are intended to explain the present invention and should not be construed as limiting the present invention.

[0051] The following describes the face key point detection method and device based on deep reinforcement learning according to the embodiment of the present invention with reference to the accompanying drawings. First, the face key point detection method based on deep reinforcement learning according to the embodiment of the present invention will be described with reference to the accompanying drawings .

[0052] figure 1 It is a flowchart of a face key point detection method based on deep reinforcement learning according to a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a face key point detection method and device based on deep reinforcement learning, wherein the method comprises the following steps: mathematically modeling a face key point detection problem by a Markov decision process; obtaining an initial shape by a shape prediction network, subjecting the initial shape to the k-nearest neighbor to obtain a shape candidate subset; evaluating each candidate shape in the shape candidate subset by the shape decision network, and obtaining the shape with the highest score; simultaneously optimizing the shape prediction network and the shape decision network by a strategy gradient to obtain the final predicted decision network structure to obtain the key points of a face. By predicting the framework of decision, the method can find an optimal shape search path in the shape continuous space to maximize the shape evaluation score, thereby effectively improving the accuracy and reliability of face key point detection.

Description

technical field [0001] The present invention relates to the technical field of computer vision, in particular to a method and device for detecting human face key points based on deep reinforcement learning. Background technique [0002] Face key point detection aims at locating the positions of multiple feature key points (such as eyebrows, eyes, nose, mouth, face profile, etc.) for a given face image. This technology plays an important role in multiple face analysis characters, such as face recognition, head pose estimation, face attribute analysis, etc. [0003] Although a series of methods have been devoted to the research of face key point detection in recent years, the problem of face key point detection is still very challenging. This is mainly due to the fact that the face images obtained in natural open scenes have great variability due to large postures and large expressions, which makes the algorithm of face key point detection easy to fall into local optimum, and...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00
CPCG06V40/171G06V40/161
Inventor 鲁继文周杰刘昊郭明皓
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products