IP-FSRGAN-CA face image super-resolution reconstruction algorithm based on coordinate attention mechanism

An IP-FSRGAN-CA, super-resolution reconstruction technology, applied in the field of super-resolution reconstruction of face pictures, can solve problems such as blurring, loss of image information, and low image resolution

Pending Publication Date: 2021-11-19
HENAN UNIVERSITY OF TECHNOLOGY
View PDF0 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In real monitoring scenarios, due to factors such as video collection equipment, natural weather conditions, unrestricted human activities, and actual project needs, the acquired images may have low resolution, blur or even distortion, which may induce staff to The misjudgment of image information causes immeasurable losses, so the task of face SR image reconstruction is imperative and has a long way to go

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • IP-FSRGAN-CA face image super-resolution reconstruction algorithm based on coordinate attention mechanism
  • IP-FSRGAN-CA face image super-resolution reconstruction algorithm based on coordinate attention mechanism
  • IP-FSRGAN-CA face image super-resolution reconstruction algorithm based on coordinate attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] Step 1: The data set used comes from 2736 face pictures of 1000 people randomly selected in the LFW data set. In the experiment, we first use a rectangular frame to detect the face in the data set, and cut it into a size of 128×128 Face image, as the face HR image of the experiment.

[0022] Step 2: Using bicubic difference method to down-sample the obtained face HR image to obtain a face LR image with a size of 32×32.

[0023] Step 3: Send the obtained face LR image as input to the super-resolution reconstruction module to obtain the face SR image and the similarity measure between the SR image and the face HR image, and the specific operation steps of the image data in the super-resolution module as follows:

[0024] The super-resolution module is a generative adversarial network, which includes a generator G and a discriminator D, G implements a G mapping of the input LR image to obtain a face SR reconstruction image, expressed as G:X→Y;D Measure the similarity bet...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

In order to solve the problem of feature loss in face feature information extraction and recovery in a traditional face super-resolution image reconstruction technology, the invention provides an IP-FSRGAN-CA face image super-resolution reconstruction algorithm based on a coordinate attention mechanism (CA). Therefore, a generator is helped to learn more face feature information and synthesize a more real super-resolution face picture. When the amplification factor is 4, an LFW data set is adopted to test the model performance, and an experimental result shows that compared with IP-FSRGAN, the method has the advantages that the peak signal-to-noise ratio (PSNR) is improved by 0.14%, the structural similarity (SSIM) is improved by 0.59%, the PSNR on a Y channel is improved by 2.43%, the SSIM is improved by 0.38%, and under the measurement of the PSNR and the SSIM, the method is quantitatively superior to existing SRGAN, ESRGAN, IP-FSRGAN and other human face reconstruction methods. Experiments prove that the IP-FSRGAN-CA face image super-resolution reconstruction algorithm based on the coordinate attention mechanism provided by the invention has effectiveness in face super-resolution image reconstruction.

Description

technical field [0001] The invention belongs to the technical field of super-resolution reconstruction, and in particular relates to a method for super-resolution reconstruction of human face pictures. Background technique [0002] In recent years, generative adversarial networks have been widely used in computer vision, especially in data set expansion, image conversion, text-image conversion, semantic image-image conversion, image editing, image mixing, image restoration, video prediction, 3D printing, etc. It was a huge success. [0003] Single image super-resolution reconstruction is an important research direction in the field of computer vision. For the capture and restoration of face image details, it has very important research significance in the fields of medical imaging, traffic surveillance, criminal investigation and tracking, border guarding, and emergency rescue. In real monitoring scenarios, due to factors such as video collection equipment, natural weather ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/40G06K9/62
CPCG06T3/4053G06T2207/20081G06T2207/30201G06F18/214
Inventor 杨晓雅万冬厚高辉王红涛邓淼磊张德贤
Owner HENAN UNIVERSITY OF TECHNOLOGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products