Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Super-resolution method for aligning face image based on residual back projection neural network

A face image and neural network technology, applied in the field of super-resolution, can solve the problems of poor visual effect of low-resolution face images, difficulty in applying face analysis systems, etc., and achieve high structural similarity of high-resolution face images. , good visualization, high peak signal-to-noise ratio

Pending Publication Date: 2021-01-08
中央广播电视总台
View PDF6 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The purpose of the present invention is to address the poor visual effect of existing aligned low-resolution face images, which are difficult to apply to existing face analysis systems. In order to enlarge ultra-low-resolution face images, a neural network alignment based on residual back projection is proposed Super-resolution methods for face images

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Super-resolution method for aligning face image based on residual back projection neural network
  • Super-resolution method for aligning face image based on residual back projection neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0033] This example illustrates the specific implementation of the super-resolution method for aligning face images based on the residual back-projection neural network of the present invention.

[0034] When implementing the super-resolution method for aligning face images of the present invention, an open-source face image data set celebA data set is used for testing, and the data set contains 200,000 frontal face images in total. We randomly sampled 5000 face images as a validation set, 1000 face images as a test set, and the rest as a validation set. Except for the different data sets used, the training, verification and testing steps of the neural network are the same. The experimental environment adopted by the present invention: the hardware system is a TiTan X independent graphics card, the video memory is 12G, the software system is ubuntu14.04, and the pythonpytorch framework is used. Using peak signal-to-noise ratio (PSNR), and structural similarity measure (SSIM) ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a super-resolution method for aligning a face image based on a residual back projection neural network, and belongs to the technical field of image processing. A mode of combining iterative back projection and a deep learning neural network is adopted, and an ultralow-resolution face image is amplified by 8 times through three steps. The method comprises the following steps: (1) inputting an ultralow-resolution face image into a neural network, extracting depth features, and amplifying a low-resolution feature map to 128 * 128 by adopting a deconvolution network; (2) inputting the 128 * 128 feature map obtained in the step (1) into a residual back projection unit of a neural network, and obtaining a compensated 128 * 128 high-resolution feature map through continuous iteration; and (3) generating a final 128 * 128 high-resolution image through a convolution layer by using the high-resolution feature map obtained in the step (2). The method is clear in module and simple in step, and the super-resolution effect and efficiency meet the super-resolution requirement of the actual low-resolution face image.

Description

technical field [0001] The invention relates to a super-resolution method for aligning face images based on a residual back-projection neural network, and belongs to the technical field of image processing. [0002] technical background [0003] In the research field of computer vision, face image super-resolution has always been an important sub-topic. It not only has many practical application scenarios, but also is the basis of other research topics. [0004] From a practical point of view, many intelligent applications are inseparable from the support of face image super-resolution technology. The most important application is the urban surveillance system: with the rapid economic development, the video surveillance cameras around us are becoming more Many, these cameras are mainly used to build urban video surveillance systems, and play an important role in the criminal investigation business of public security organs. However, in the actual process of collecting faces ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06T3/40
CPCG06T3/4053G06V40/161G06V40/168
Inventor 陆耀王学博陈晓珍王子建李玮琪李公平吴紫薇
Owner 中央广播电视总台
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products