Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Face image restoration method introducing attention mechanism

A face image and repair method technology, applied in the field of image repair, can solve the problems of enlarged defect area and reduced repair effect, so as to achieve the effect of improving repair, improving overall repair effect, and realizing long-range correlation

Inactive Publication Date: 2020-09-01
SUN YAT SEN UNIV
View PDF3 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Traditional image restoration methods can be mainly divided into two categories: structure-based and texture-based. They can achieve better repair results in the case of small-scale information loss, but the repair effect drops sharply when the defect area becomes larger.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Face image restoration method introducing attention mechanism
  • Face image restoration method introducing attention mechanism
  • Face image restoration method introducing attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] The present invention will be further described below.

[0022] Concrete implementation process of the present invention is as follows:

[0023] (1) Image collection, download the public CelebA face data set, select 40,000 face images from about 200,000 original face images, and rename the selected original face images, such as 1.jpg, 2.jpg, 3.jpg, ..., 40000.jpg.

[0024] (2) Image division, divide 40,000 original face images into training set and test set according to the ratio of 7 to 1, of which 35,000 training sets are used to train the repair model later, and 5,000 test sets are used to evaluate the trained restoration The repair performance of the model.

[0025] (3) Image preprocessing, in order to cut out the redundant background in the face image of the original CelebA dataset, use the face detection algorithm in the Dlib libraryHistogram of Gradient Orientation (HOG) to detect and cut the face of the original CelebA image Out of the face area. HOG workfl...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a face image restoration method introducing an attention mechanism, and the method comprises the steps: (1) obtaining an original data set, carrying out the image preprocessing, obtaining a needed face image data set, and reasonably dividing and arranging the face image data set into a test set and a data set; (2) inputting the training data set into an image restoration model introduced into a context attention layer for training, wherein two parallel encoder networks are introduced into a generator network, one encoder network is used for performing convolution operation to extract advanced feature images, and the other encoder is used for introducing a context attention layer network to realize long-range association between a foreground region and a backgroundregion; and (3) inputting the test data set into the trained face restoration model, and testing the restoration capability of the trained restoration model for the defective face image. According tothe method, after the context attention layer is introduced, the problem that the background region information cannot be fully utilized by the restoration model due to the limited receptive field size of the convolutional neural network is solved, the long-range association of the background information and the foreground region is realized, and the background region information is fully utilizedto fill the foreground region. After the context attention layer is introduced, the restoration model obtains a better restoration effect on some detail textures, and the restoration effect of the face image is also improved on the whole.

Description

technical field [0001] The invention relates to the field of image restoration, in particular to a human face image restoration method introducing an attention mechanism. Background technique [0002] The advent of the information age has made digital image information the main way for people to transmit information to each other. In the process of acquiring, compressing, and transmitting massive image information, it is inevitable that some information will be lost. The information is of great significance in many fields. Traditional image restoration methods can be mainly divided into two categories: structure-based and texture-based. They can achieve better repair results in the case of small-scale information loss, but the repair effect drops sharply when the defect area becomes larger. The emergence of deep learning methods, especially the emergence of generative confrontation networks and deep convolutional neural networks, enables us to achieve better results in imag...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/00G06T5/40G06T7/11G06T7/194G06K9/62
CPCG06T5/40G06T7/11G06T7/194G06T2207/10004G06T2207/20084G06T2207/20081G06T2207/30201G06T2207/20132G06F18/2411G06T5/77
Inventor 王高平许曼玲戴宪华
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products