Image restoration method and system based on conditional generative adversarial network

A conditional generation and repair method technology, applied in biological neural network models, image enhancement, image analysis and other directions, can solve the problems of training collapse, stay, model freedom and uncontrollable, and achieve the effect of increasing efficiency and saving training time.

Pending Publication Date: 2019-12-20
CHINA UNIV OF GEOSCIENCES (WUHAN)
View PDF2 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing image restoration algorithms based on deep learning are all based on supervised learning, which brings many restrictive factors to image restoration.
In the field of unsupervised learning, the generative adversarial network (GAN) proposed by Goodfellow in 2014 has made groundbreaking progress. I

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image restoration method and system based on conditional generative adversarial network
  • Image restoration method and system based on conditional generative adversarial network
  • Image restoration method and system based on conditional generative adversarial network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] In order to have a clearer understanding of the technical features, purposes and effects of the present invention, the specific implementation manners of the present invention will now be described in detail with reference to the accompanying drawings.

[0030] Embodiments of the present invention provide an image restoration method and system based on a conditional generative confrontation network.

[0031] Please refer to figure 1 , figure 1 It is a flowchart of an image restoration method based on a conditional generation confrontation network in an embodiment of the present invention, specifically including the following steps:

[0032] S101: Obtain a training data set, and preprocess data in the training data set to obtain a preprocessed training data set;

[0033] S102: Using the preprocessed training data set as the training data set of the CGAN network to train the CGAN network to obtain a trained CGAN network;

[0034] S103: Input the image to be repaired in...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an image restoration method and system based on a conditional generative adversarial network. The image restoration method comprises the steps: firstly, training a conditional generative adversarial network CGAN on a CelebA data set, then inputting a to-be-restored image into the CGAN to generate a series of fake images similar to the to-be-restored image, and defining a loss function composed of context loss and perception loss, wherein the context loss ensures the similarity between the image to be restored and the restored image content, and the perception loss guarantees to visually output a complete and vivid image; and finally, mapping the to-be-repaired image to a small potential space by utilizing a back propagation algorithm of the loss function, and inputting the mapped vector into the CGAN to generate an optimal forged image of the to-be-repaired image. The image restoration method has the advantages that the image restoration method based on the conditional generative adversarial network is provided to solve the problems of unstable training and collapse of the generative adversarial network fundamentally and thoroughly, and obtain an optimal forged image in combination with context loss and perception loss functions to complete image missing area restoration.

Description

technical field [0001] The invention relates to the field of computer vision image restoration, in particular to an image restoration method and system based on a conditional generation confrontation network. Background technique [0002] Image restoration originated from people’s restoration of artworks during the Renaissance. Reconstruction of beautiful artworks inherits national culture for people to appreciate and learn. Using the neighborhood information of the missing area of ​​​​the image, the missing area is restored according to certain restoration rules, so that the observer There is no visual perception that the image has ever been damaged or has been repaired. Since the 1980s, with the rapid development of computer artificial intelligence and digital media technology, the restoration of works of art has changed from traditional pure manual restoration to computer automatic detection of damaged areas and completion of restoration. Digital image restoration techno...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T5/00G06N3/08
CPCG06T5/005G06N3/08G06T2207/20081G06T2207/20084
Inventor 金星夏伟
Owner CHINA UNIV OF GEOSCIENCES (WUHAN)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products