Image super-resolution reconstruction method based on convolutional neural network

A convolutional neural network and super-resolution reconstruction technology, applied in the field of image super-resolution reconstruction based on convolutional neural network, can solve the problem that the three-layer structure cannot meet the fineness and other problems

Active Publication Date: 2019-07-02
SHENYANG INST OF AUTOMATION - CHINESE ACAD OF SCI
View PDF9 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the three-layer structure of SRCNN cannot meet the requirements of higher fineness. According to the characteristics of convolutional neural network, the first few layers can only obtain the shallow texture information of the image, and only the deeper convolutional network can be used to obtain more detailed features. to reconstruct high-quality images

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image super-resolution reconstruction method based on convolutional neural network
  • Image super-resolution reconstruction method based on convolutional neural network
  • Image super-resolution reconstruction method based on convolutional neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments.

[0031] The present invention includes the following processes:

[0032] First convert the image of the RGB channel to the image of the YCbCr channel, and reconstruct each channel; then design an eight-layer convolutional neural network structure, determine the size and number of convolution kernels in each layer, and optimize the CNN, including Optimization of the initialization parameters weights and bias, and optimization of the activation function; finally, the shallow feature information is learned through the four-layer network of SRCNN, and migrated to the TLSRCNN proposed by the present invention, and the final four-layer network strengthens the salient features to complete the final image super Resolution reconstruction.

[0033] Such as figure 1 Shown is the eight-layer end-to-end neural network model structure diagram based on feat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an image super-resolution reconstruction method based on a convolutional neural network, and the method comprises the steps: training an SRCNN convolutional neural network model through a data set, and obtaining the shallow texture feature information; establishing an eight-layer end-to-end neural network model based on feature transfer, and migrating shallow texture feature information to the first four layers of the neural network model to obtain model parameters of the first four layers; obtaining model parameters of four rear layers of the neural network model, andenhancing learnt characteristics; inputting image data to be reconstructed, and preprocessing the image data; obtaining a high-resolution image of the Y channel; and fusing the high-resolution imageof the Y channel, the image of the Cb channel and the image of the Cr channel to obtain a reconstructed image. According to the convolutional neural network model provided by the invention, a better super-resolution result is obtained, the subjective vision and objective evaluation indexes are obviously improved, the image definition and the edge sharpness are obviously improved, the convergence speed is higher, and the method has higher advantages in the aspect of fineness.

Description

technical field [0001] The invention relates to the fields of computer vision and digital image processing, in particular to an image super-resolution reconstruction method based on a convolutional neural network. Background technique [0002] Single image super-resolution (Super Resolution, SR) reconstruction is a classic problem in the field of computer vision, and its purpose is to obtain a high-resolution image from a low-resolution image. Through the method of signal processing and image processing, the problem of reconstructing a high-resolution (High Resolution, HR) output image with the highest quality. There are multiple solutions for any given low-resolution pixel image. This is a typical ill-conditioned inverse problem with serious ill-posedness, and prior information is needed to solve this problem. [0003] Convolutional neural network (CNNs) can obtain high-frequency features of images, enhance detailed information, and is particularly good at obtaining correl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/40G06N3/04
CPCG06T3/4061G06N3/045
Inventor 赵怀慈刘明第郝明国王立勇刘鹏飞赵洋
Owner SHENYANG INST OF AUTOMATION - CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products