Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image super-resolution reconstruction method combining depth supervision self-coding and perception iteration back projection

An iterative back-projection and super-resolution technology, applied in the field of image processing, can solve problems such as blur

Active Publication Date: 2019-08-09
UNIV OF ELECTRONIC SCI & TECH OF CHINA
View PDF15 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The invention solves the problem of image super-resolution reconstruction under complex degradation models such as noise, blur, compression, and downsampling, and proposes a new image super-resolution reconstruction method

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image super-resolution reconstruction method combining depth supervision self-coding and perception iteration back projection
  • Image super-resolution reconstruction method combining depth supervision self-coding and perception iteration back projection
  • Image super-resolution reconstruction method combining depth supervision self-coding and perception iteration back projection

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0012] The present invention comprises 2 steps:

[0013] Step 1 uses a deep self-encoder to learn a complex image degradation model, and receives training image pairs under complex degradation conditions to focus on training the encoder part;

[0014] Step 2 uses the deep convolutional neural network in the encoder part of the deep autoencoder as the degradation model in the iterative back-projection algorithm, uses the bicubic interpolation image as the initial value of the super-resolution image iteration, and calculates the degraded and observed super-resolution image The perceptual loss of the image in feature space and is used to iteratively update the super-resolution image until the loss is below a threshold.

[0015] The two steps are described in detail below:

[0016] 1. Learning complex image degradation models through deep autoencoders

[0017] Generally speaking, a low-resolution image is degraded from its corresponding high-resolution image, and the interferenc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an image super-resolution reconstruction method combining depth supervision self-coding and perception iteration back projection. Compared with an existing method, a reconstruction model is directly trained, a low-resolution image is input into the trained reconstruction model to directly obtain a super-resolution image, and the reconstruction model cannot be adjusted afterbeing trained. According to the method, the degradation process from the super-resolution image to the low-resolution image is regarded as encoding, and the reconstruction process from the low-resolution image to the super-resolution image is regarded as decoding, so that an encoder reflecting an image complex degradation model is trained. According to the method, a bicubic interpolation image isused as an iteration initial value of the super-resolution image, a degenerated image of the super-resolution image generated by each iteration is obtained by using a trained encoder, the degeneratedimage is compared with an actual low-resolution image to obtain perception loss, and then the super-resolution image is updated by using the perception loss. According to the method, interference of large margin such as blur, jitter, noise and the like can be eliminated, and a high-resolution image can be reconstructed.

Description

technical field [0001] The invention belongs to the field of image processing and is mainly used for single image super-resolution reconstruction. [0002] technical background [0003] Image super-resolution reconstruction (Super-Resoluion, SR) is a research hotspot in the field of computer vision at present. Image, eliminate the irreversible degradation in the process of acquisition, transmission and storage, and reconstruct a clear and complete high-resolution image. Super-resolution reconstruction has a wide range of application scenarios in smart cities, big data medical care, multimedia social networking, autonomous driving and other fields, and is a very important digital image processing technology. Current image super-resolution reconstruction techniques include image interpolation methods, neighborhood embedding methods, sparse coding methods, and deep learning methods. These methods all presuppose the degradation relationship between bicubic interpolation and dow...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T3/40
CPCG06T3/4076G06T3/4046
Inventor 解梅钮孟洋赵雷廖炳焱
Owner UNIV OF ELECTRONIC SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products