Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Single image super-resolution reconstruction method based on conditional generative adversarial network

A super-resolution reconstruction and conditional generation technology, applied in the field of image processing, can solve problems such as training collapse, uncontrollable GAN, poor detail effect, etc., and achieve the effect of improving discrimination accuracy

Active Publication Date: 2019-08-16
NANJING UNIV OF INFORMATION SCI & TECH
View PDF4 Cites 128 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

A Super-Resolution Using a Generative Adversarial Network (SRGAN) algorithm based on a Generative Adversarial Network (SRGAN) is proposed. Although this game-like optimized SRGAN can generate high-quality images, the details are poor, and using this network Training is too free
The input of the GAN model lacks constraints. For larger input pictures or more pixels, the training will collapse, making the GAN uncontrollable.
In addition, SRGAN training uses a large number of training data sets, and the computer hardware configuration is relatively high, which is not conducive to the popularization of academic research and industrial applications

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Single image super-resolution reconstruction method based on conditional generative adversarial network
  • Single image super-resolution reconstruction method based on conditional generative adversarial network
  • Single image super-resolution reconstruction method based on conditional generative adversarial network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0056] Such as figure 1 As shown, a single image super-resolution learning method based on conditional generative confrontation network of this embodiment includes the following steps:

[0057] Step 1: The training set is composed of high-resolution images and low-resolution images obtained by downsampling the high-resolution images; specifically:

[0058] Using the 16,700 high-resolution training images of the VOC2012 training set, the high-resolution training images are down-sampled by 4 times using the bicubic interpolation method to obtain low-resolution images. Then use the random cropping method to randomly crop a high-resolution image block of size 88x88 for each high-resolution training image, and crop an image block of size 22x22 in the corresponding low-resolution image at the same position. In this way, training image blocks of corresponding proportions are obtained, and finally high and low resolution training image blocks are obtained;

[0059] The random cropp...

Embodiment 2

[0094] The single image super-resolution learning method based on the conditional generation confrontation network of the present embodiment includes the following steps:

[0095] Step 1: Downsample the high-resolution training image to obtain a low-resolution training image. Specifically: the VOC2012 training set is adopted, and of course the present invention is also applicable to other training sets. The algorithm used for the low-resolution images obtained by downsampling the high-resolution training images is the bicubic interpolation algorithm. Second, corresponding random cropping of high and low resolution images is required. The crop size can be set, but the high-resolution tiles are 4 times the size of the low-resolution tiles. Cropping is to randomly crop an image patch on each image. This embodiment is also suitable for randomly cropping multiple image blocks for training;

[0096] Step 2: Downsampling the images in the test set to obtain low-resolution test im...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a single image super-resolution reconstruction method based on a conditional generative adversarial network. A judgment condition, namely an original real image, is added intoa judger network of the generative adversarial network. A deep residual error learning module is added into a generator network to realize learning of high-frequency information and alleviate the problem of gradient disappearance. The single low-resolution image is input to be reconstructed into a pre-trained conditional generative adversarial network, and super-resolution reconstruction is performed to obtain a reconstructed high-resolution image; learning steps of the conditional generative adversarial network model include: learning a model of the conditional adversarial network; inputtingthe high-resolution training set and the low-resolution training set into a conditional generative adversarial network model, using pre-trained model parameters as initialization parameters of the training, judging the convergence condition of the whole network through a loss function, obtaining a finally trained conditional generative adversarial network model when the loss function is converged,and storing the model parameters.

Description

technical field [0001] The invention relates to a single image super-resolution reconstruction method based on a conditional generation confrontation network, which belongs to the field of image processing, in particular to a super-resolution reconstruction method. Background technique [0002] Single image super-resolution (SISR) aims to recover a high-resolution image (HR) from a single low-resolution image (LR). This has direct applications in many fields such as HDTV, medical imaging, satellite imaging, face recognition and video surveillance. At present, people have higher and higher requirements for images, especially in terms of clarity. Improving image clarity purely from the hardware aspect is not only costly but also technically reaches a certain bottleneck. Improve the image resolution from the software, to a certain extent overcome the problem of insufficient hardware. Therefore, image super-resolution reconstruction has become one of the research hotspots. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T3/40G06N3/04G06N3/08
CPCG06T3/4053G06N3/08G06N3/044G06N3/045Y02T10/40
Inventor 宋慧慧乔娇娇张开华
Owner NANJING UNIV OF INFORMATION SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products