Image super-resolution reconstruction method based on cascade residual convolutional neural network

A convolutional neural network and super-resolution reconstruction technology, which is used in video and image processing. In the field of high-resolution image reconstruction, residual convolutional neural network can solve the problem of PSNR value drop of reconstructed image, poor subjective perception effect of reconstructed image, etc. problem, to achieve the effect of accelerating the convergence speed and simplifying the training process

Pending Publication Date: 2019-09-24
TIANJIN UNIV
View PDF1 Cites 43 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The loss function used in the above CNN network training is the minimum mean square error loss. Although it is beneficial to obtain a higher peak signal-to-noise ratio (PSNR), the subjective perception effect of the reconstructed image is poor. In order to solve such problems, from Ledig et al. of Twitter proposed the SRGAN [20] network, which completed the reconstruction of high-resolution images by c

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image super-resolution reconstruction method based on cascade residual convolutional neural network
  • Image super-resolution reconstruction method based on cascade residual convolutional neural network
  • Image super-resolution reconstruction method based on cascade residual convolutional neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] As a classic topology in artificial neural networks, convolutional neural networks have a wide range of applications in the fields of pattern recognition, image and speech information analysis and processing. In the field of image super-resolution reconstruction, after Dong Chao and others first proposed the SRCNN[4] network and successfully applied the convolutional neural network (CNN) to the restoration and reconstruction of high-resolution images, many improved CNNs have been successively adopted. proposed, and have achieved significant improvement in the key reconstruction effect evaluation indicators.

[0032] In order to obtain better reconstruction results, the existing super-resolution reconstruction methods of CNN-based images often have very deep network layers, resulting in too long network training time, slow convergence speed, and more prone to gradient disappearance or Gradient explosion and other problems increase the difficulty of network training. At ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the field of video and image processing. The objective of the invention is to effectively reduce the reconstruction difficulty of a high-resolution image, the good feature extraction capability of a convolutional neural network and the fitting capability of complex mapping. According to the image super-resolution reconstruction method based on the cascade residual convolutional neural network, the basic residual networks with the same structure are cascaded to form the cascade residual convolutional neural network, so that end-to-end mapping from inputting the low-resolution image to outputting the high-resolution image is realized; the basic residual network comprises a global residual channel and a feature extraction channel; down-sampling processing is carried out on the original high-resolution color image, so as to obtain a corresponding low-resolution image according to a basic residual network, performing bicubic interpolation upsampling on the low-resolution image to obtain an interpolation image, sending the interpolation image into a global residual channel of the basic residual network, and finally realizing information transmission between different levels of residual networks and forming final output. The image super-resolution reconstruction method is mainly applied to video and image processing occasions.

Description

technical field [0001] The invention belongs to the field of video and image processing, and relates to the improvement of image super-resolution reconstruction methods, the fusion of deep learning theory and image super-resolution reconstruction, and the implementation and application of residual convolutional neural networks in the field of high-resolution image reconstruction . Background technique [0002] Image super-resolution refers to the process of obtaining corresponding high-resolution images by using single or multiple low-resolution degraded image sequences. In many practical applications in the field of image processing, people often hope to obtain high-resolution original images, because high-resolution images mean higher pixel density, which can provide richer high-frequency detail information, so as to provide more information for the later stages of the image. Accurate extraction and utilization of processing and image information create a good foundation....

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T3/40G06T11/00
CPCG06T3/4053G06T11/003
Inventor 李素梅刘人赫薛建伟侯春萍
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products