Image super-resolution reconstruction method of improved convolution network based on data enhancement

A super-resolution reconstruction and convolutional network technology, applied in the field of image super-resolution reconstruction, can solve the problems of no image information combined with the network structure, the reconstruction accuracy needs to be improved, and the network training convergence is slow, so as to avoid image resolution. The effect of descending, speeding up training convergence, and restoring image resolution

Inactive Publication Date: 2017-07-14
GUILIN UNIV OF ELECTRONIC TECH
View PDF7 Cites 23 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the small data set of the network during the training process makes the convergence of the network training slow, and at the same time, the structure characteristics of the network layer cause the lack of useful information obtained, which ultimately leads to low image reconstruction accuracy.
[0003] CN106228512A is based on the learning rate adaptive convolutional neural network image super-resolution reconstruction method, which is directly applied to the convolutional neural network. The innovation is to add a BN layer after each convo

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image super-resolution reconstruction method of improved convolution network based on data enhancement
  • Image super-resolution reconstruction method of improved convolution network based on data enhancement

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0022] The present invention is based on the image super-resolution reconstruction method of the improved convolution network of data enhancement, and concrete steps are as follows:

[0023] (1) Data enhancement: 91 images in the sample set are rotated 90°, 180°, 270°, flipped 0°, 90°, 180°, 270° seven operations, and then the steps are r=14, with overlap The cropping of 168000 fsub×fsub sub-images is obtained as the original HR image, where fsub=33; then Gaussian blur downsampling is performed on the original image to obtain the input dataset {Yi}.

[0024] (2) Network structure improvement: Construct a four-layer network model, such as figure 1 As shown, the first three layers of the network are composed of convolutional layers, which are used to extract image feature information as a feature extraction layer; the last layer is a deconvolutional layer as a reconstruction layer, and the feature information obtained by the convolutional layer is used for reconstruction, thus o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an image super-resolution reconstruction method of an improved convolution network based on data enhancement. The method comprises steps of data enhancement and network structure improvement. On one hand, variety of samples are increased by adopting the mode of multi-angle rotation and rotation of a sample set, so features of multi-angle backgrounds can be acquired and rotation invariance of the features is achieved. Sufficient feature information is beneficial to improvement of reconstruction precision of an image. On the other hand, in the network model provided by the method, features are extracted by use of a deep convolution neural network, so multiple layers of convolution layers are beneficial to more advanced extraction and more complete features. De-convolution layers are used as reconstruction layers for carrying out feature mapping on output of the convolution layers so as to recover the image resolution, so the super-resolution image is obtained. The convolution layer is lack of the rotation invariance feature, so due to the variety of the samples in the provided method, an objective of increasing parameters is achieved, so the network is well fitted, improvement of the reconstruction precision is finally achieved and an effect of accelerating convergence speed of a network training is achieved.

Description

technical field [0001] The invention relates to the technical field of image processing, in particular to an image super-resolution reconstruction method based on a data-enhanced improved convolutional network. Background technique [0002] In recent years, image super-resolution reconstruction technology has gradually matured and is widely used in the field of medical images, satellite images, and face recognition. The techniques can be divided into three categories: interpolation-based algorithms, reconstruction-based algorithms, and learning-based algorithms. Since learning-based algorithms are more effective, most scholars are exploring and researching on this basis. Currently, learning-based methods learn the mapping relationship between low-resolution image patches and high-resolution image patches. Although the sparse coding algorithm proposed by Yang et al. has some breakthroughs, this method mainly adjusts the process of dictionary learning and sparse regularizati...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T3/40G06T3/60G06T5/00
Inventor 欧阳宁曾梦萍林乐平莫建文袁华张彤首照宇
Owner GUILIN UNIV OF ELECTRONIC TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products