Super-resolution reconstruction method based on dirac residual deep neural network

A deep neural network and super-resolution reconstruction technology, applied in the field of image reconstruction, can solve the problems of poor reconstruction effect and achieve good reconstruction effect

Pending Publication Date: 2019-09-06
NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
View PDF2 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Each residual block is an activation function added to the two convolutional layers, and the output of the second convolution is added to the input of the first convolution as the output of the residual block. When the network depth increases, The reconstruction effect is not improved well

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Super-resolution reconstruction method based on dirac residual deep neural network
  • Super-resolution reconstruction method based on dirac residual deep neural network
  • Super-resolution reconstruction method based on dirac residual deep neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0043] (1) Data set preparation. The training set uses the training set part of the public dataset DIV2K. The test set includes the test set parts of Set5, Set14, B100, Urban100 and DIV2K. For each HR image, there are corresponding LR images (×2,×3,×4) as input.

[0044] (2) The network uses an image with a size of 48×48×3 as the input of the network. These images are obtained by cropping the dataset images. Since there are more than one input images for each iteration of training, n is used to represent the number of inputs, and the input is expressed as a tensor [n,48,48,3], and the corresponding output tensor is: ×2:[n,96, 96,3], ×3: [n,144,144,3], ×4: [n,192,192,3].

[0045] (3) The input image format is a 24-bit RGB image, and each pixel contains three-dimensional information of R, G, and B. Each dimension is represented by 0 to 255. Preprocessing is performed after the image is input, and each dimension of the image is represented by -127 to 128. The specific oper...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a super-resolution reconstruction method based on a dirac residual deep neural network. The super-resolution reconstruction method comprises the steps: a network inputs a low-resolution image, learns image features through a plurality of dirac parameterized residual blocks, and employs sub-pixel convolution to reconstruct a high-resolution image; the network is divided intoan upper part and a lower part, and the upper part obtains high-frequency features of the LR through the deep dirac residual network, and then carries out reconstruction through sub-pixel convolution; the lower part reconstructs an image directly by sub-pixel convolution of low frequency features of the LR; and a reconstructed HR image is output by combining the two reconstruction structures. According to the super-resolution reconstruction method, the residual layer is improved through weight parameterization; the convolution feature dimension before the activation function Relu is reduced;and the convolution feature dimension after the activation function is increased. Meanwhile, the convolutional features of the input image and the features of residual network learning are combined for reconstruction, and a better SR effect is obtained under the condition that the network depths are the same.

Description

technical field [0001] The invention relates to a super-resolution reconstruction method based on a dirac residual deep neural network, and belongs to the technical field of image reconstruction. Background technique [0002] Super-resolution reconstruction (SR) refers to the estimation of high-resolution (high-resolution, HR) images or videos obtained by observing one or more low-resolution (low-resolution, LR) images of the same scene. . SR breaks through the limitations of imaging system hardware through digital image processing and machine learning methods to obtain images with higher spatial resolution and more detailed information. It is currently an efficient and low-cost technical means to obtain high-definition images. [0003] SR can be divided into three categories according to different input and output methods, namely single-input single-output (SISO), multiple-input single-output (MISO) and multiple-input multiple-output (MIMO), among which MIMO belongs to vid...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/40G06N3/08
CPCG06T3/4053G06N3/08
Inventor 杨欣谢堂鑫朱晨周大可李晓川李志强
Owner NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products