Face super-resolution reconstruction method based on deep learning

A technology of super-resolution reconstruction and deep learning, applied in image data processing, instrumentation, computing, etc., can solve problems such as low resolution, out-of-focus blur, and motion blur

Inactive Publication Date: 2018-04-24
GOSUN GUARD SECURITY SERVICE TECH
View PDF4 Cites 51 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] (1) SR is an inverse problem. For a low-resolution image, there may be many different high-resolution images corresponding to it
[0007] (2) The low-quality images obtained in real multimedia applications are often complex degraded images with multiple degraded factors, such as low resolution, out-of-focus blur, motion blur, compression distortion and noise, etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Face super-resolution reconstruction method based on deep learning
  • Face super-resolution reconstruction method based on deep learning
  • Face super-resolution reconstruction method based on deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] Such as figure 1 As shown, the present invention discloses a face super-resolution reconstruction method based on deep learning. The specific implementation of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0041] Step 1: Use the Multi-task convolutional neural networks (MTCNN) algorithm to extract 5 key points of the face. The face data uses the CelebA dataset, which contains 202,599 pictures of 10,177 individuals. The MTCNN algorithm is composed of three network structures (P-Net, R-Net, O-Net), wherein P-Net (Propsoal Network) mainly obtains candidate windows and frame regression vectors of the face area; R-Net (Refine Network) obtains more accurate candidate windows on the basis of P-Net; O-Net (Output Network) further improves the window accuracy on the basis of R-Net, and outputs 5 key point coordinates at the same time. The coordinates of the five key points include the coordinates of the left eye, the ri...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a face super-resolution reconstruction method based on deep learning, and aims to utilize the deep learning technology to train low resolution face data, thus obtaining a mapping function from the low resolution face to the high resolution face; the technical keys comprise the following steps: 1, extracting key points of a training face data set; 2, calculating a face angleaccording to the extracted key points, and selecting a relatively right face image; 3, correcting the relatively right face image; 4, segmenting the corrected face image into the left eyebrow, the left eye, the right eyebrow, the right eye, the nose and the mouth, and respectively training said parts; 5, super-resolution processing the eyebrow, eye, nose and mouth images, super-resolution processing the face image, and combining said images so as to obtain the final super-resolution face image. The face super-resolution reconstruction method based on deep learning can effectively improve theobtained face image quality without changing the imaging system hardware equipment.

Description

technical field [0001] The invention belongs to the field of image processing, in particular to a face super-resolution reconstruction method based on deep learning. Background technique [0002] Image super resolution (super resolution, SR) is the process of obtaining a high-resolution image from a low-resolution image. This technology is mainly used to enhance the spatial resolution of the image, which can break through the limitations of the original system imaging hardware conditions. Re-acquired high-resolution images have the characteristics of higher resolution, more detailed information, and higher quality picture quality, and are currently one of the most effective and lowest-cost ways to obtain high-precision images. [0003] In the field of video surveillance, because the camera has a wide field of view and is far away from the face, the detected face is often very small. At the same time, due to the limitations of imaging conditions and imaging methods, the imagi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/40
CPCG06T3/4053
Inventor 章东平倪佩青毕崇圆杨力肖刚
Owner GOSUN GUARD SECURITY SERVICE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products