Unlock instant, AI-driven research and patent intelligence for your innovation.

Multi-task detection device for face key point location and semantic segmentation

A face key point and semantic segmentation technology, applied to instruments, character and pattern recognition, computer components, etc., to achieve the effects of increasing accuracy, reducing information loss, and improving convergence speed

Active Publication Date: 2018-07-20
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF5 Cites 32 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In order to solve the above-mentioned problems in the prior art, that is, in order to solve the technical problem of how to improve the accuracy of face key point positioning and face semantic segmentation at the same time, the present invention provides a multi-functional face key point positioning and semantic segmentation task detection device

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-task detection device for face key point location and semantic segmentation
  • Multi-task detection device for face key point location and semantic segmentation
  • Multi-task detection device for face key point location and semantic segmentation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] Preferred embodiments of the present invention are described below with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are only used to explain the technical principles of the present invention, and are not intended to limit the protection scope of the present invention.

[0043] The multi-task detection device used for face key point location and semantic segmentation in this embodiment mainly includes a multi-task depth model, which can be configured to use a deep learning algorithm to perform semantic segmentation on a target face image and obtain the target face image Face key points in .

[0044] See attached figure 1 , figure 1 The main structure of the multi-task depth model in this embodiment is shown as an example. Such as figure 1 As shown, the multi-task depth model in this embodiment mainly includes a key point positioning module, a semantic segmentation module, a first model training module, a s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of digital image processing, specifically relates to a multi-task detection device for face key point location and semantic segmentation and aims to solvea technical problem of how to simultaneously improve the face key point location accuracy and the face semantic segmentation accuracy. For this purpose, a multi-task depth model in the invention can adopt a deep learning algorithm to perform semantic segmentation on a target face image and obtain face key points in the target face image. Specifically, a key point location module can obtain location information of the face key points according to face features based on a coding network, and a semantic segmentation module can perform semantic segmentation on a feature map based on a decoding network. In the invention, the multi-task depth model adopts a coding-decoding network structure, and introduces shallow information in the coding network into the decoding network through an informationenhancement unit at the same time, thereby being capable of giving consideration to collaborative information between face key point location and semantic segmentation, and thus providing high face key point location accuracy and high semantic segmentation accuracy.

Description

technical field [0001] The invention relates to the technical field of digital image processing, in particular to a multi-task detection device for human face key point positioning and semantic segmentation. Background technique [0002] Face image analysis technology is mainly used in the fields of emotion recognition and face recognition. Among them, face key point positioning technology and face semantic segmentation technology, as the basic analysis technology in face image analysis technology, the detection results will be It greatly affects the final face image analysis results. At present, in the process of face image analysis, a separate processing method is mainly used, that is, face key point positioning and face semantic segmentation are implemented separately, but this processing method does not consider the relationship between face key point positioning and face semantic segmentation. Therefore, some information will be lost and the accuracy of face image anal...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/34G06K9/62
CPCG06V40/168G06V10/267G06F18/214
Inventor 赵昱程唐帆董未名张晓鹏
Owner INST OF AUTOMATION CHINESE ACAD OF SCI