Face image super-resolution method based on improved deep iterative collaborative network

A collaborative network and face image technology, applied in the field of face image super-resolution, can solve the problems of underutilization of face structure information, large model parameters, etc., to improve super-resolution performance, small parameter scale, super-resolution good effect

Active Publication Date: 2022-05-24
SOUTH CHINA UNIV OF TECH
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to address the shortcomings of the existing deep iterative collaborative network, considering the problems of insufficient use of face structure information, large model parameter scale, space and time overhead, etc., and propose a face recognition algorithm based on an improved deep iterative collaborative network. Image super-resolution method, this method makes full use of face structure information to promote the image super-resolution process, through training, the network can be continuously optimized to improve the super-resolution effect of face images

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Face image super-resolution method based on improved deep iterative collaborative network
  • Face image super-resolution method based on improved deep iterative collaborative network
  • Face image super-resolution method based on improved deep iterative collaborative network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] The present invention will be described in further detail below with reference to the embodiments and the accompanying drawings, but the embodiments of the present invention are not limited thereto.

[0030] like figure 1 and figure 2As shown, the face image super-resolution method based on the improved deep iterative cooperation network provided by this embodiment is mainly based on the improved deep iterative cooperation network to perform the super-resolution reconstruction of a single face image. Both the image super-resolution sub-network and the prior information extraction sub-network of the original deep iterative collaborative network have been improved; among them, the improvement of the image super-resolution sub-network is: a spatial attention mechanism and a channel attention mechanism are proposed. A functional module to make full use of the prior features of the face. This module is called the FSAU module, which uses six FSAU modules and a convolutional...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a face image super-resolution method based on an improved deep iterative collaborative network, and the method comprises the steps: 1), carrying out the early-stage data processing, and obtaining low-resolution face image data; 2) inputting a low-resolution face image into an image super-resolution sub-network, and processing the face image by a shallow feature extraction module to obtain shallow features; 3) the output of the shallow feature and prior information extraction sub-network in the last iteration process is sent to the image super-resolution sub-network to obtain high-resolution features, and a reconstruction module reconstructs the high-resolution features to obtain a high-resolution image; 4) inputting the high-resolution image into the prior information extraction sub-network, and outputting a face key point thermodynamic diagram, a semantic analysis diagram and intermediate layer features at the same time; and (5) repeating the steps (3) and (4), and carrying out iteration for N times to obtain final high-resolution image output. According to the method, the structure information of the face image is fully considered, the super-resolution effect of the face image is better, the parameter scale is smaller, and the time overhead is smaller.

Description

technical field [0001] The invention relates to the technical field of deep learning image processing, in particular to a face image super-resolution method based on an improved deep iterative collaboration network. Background technique [0002] Image super-resolution refers to the restoration of low-resolution images into high-resolution images, while face image super-resolution is a specific application of image super-resolution technology in the field of face. Many technologies related to the face field, such as face recognition or face beautification, will be extremely degraded when applied to low-resolution face images. However, in real scenes, due to the influence of shooting equipment, distance and noise, there are often only low-resolution face images. Therefore, face image super-resolution is crucial for these face domain-related technologies. [0003] As deep learning shines brightly in the image field, image super-resolution technology based on deep learning has...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/40G06N3/04G06N3/08G06V40/16
CPCG06T3/4053G06T3/4046G06T3/4038G06N3/082G06T2207/20081G06T2207/20084G06T2207/30201G06N3/045
Inventor 李成杰肖南峰
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products