Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image super-resolution reconstruction method based on deep neural network

A deep neural network and super-resolution reconstruction technology, applied in the field of image processing, can solve the problem of losing the sensory authenticity of the image, and achieve the effect of good image authenticity, fast model convergence training speed, and improved convergence speed.

Pending Publication Date: 2021-11-19
NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

They believe that most super-resolution algorithms use L2 as the loss function, so the PNSR index becomes better, but the reconstructed image is too smooth and loses the sensory authenticity of the image

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image super-resolution reconstruction method based on deep neural network
  • Image super-resolution reconstruction method based on deep neural network
  • Image super-resolution reconstruction method based on deep neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0050] Step 1: Dataset preparation. The most commonly used data sets in the field of image processing are: Set5, Set14, Urban100, GeneraL100, DIV2K. This training was carried out using the five datasets mentioned here. When training the General00 data set, since the GUP used at that time was only 1660S, only the size of 100×100 in the middle of the image was intercepted for reconstruction.

[0051] Step 2, for each HR image, we train LR images with amplification factors of ×2, ×3 and ×4 respectively, and the batch size is set to 64. And when training the high-power network, the output of the low-power network is used as pre-training, and the parameters of the former are used to initialize the model of the latter, which can improve efficiency and increase the quality of the results.

[0052] Step 3, using the first convolutional layer to perform feature extraction on the original input LR image. The size of each convolution kernel is 3*3, and no activation function is used t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an image super-resolution reconstruction method based on a deep neural network, and the method comprises the steps: inputting an LR original image into a feature extraction module, extracting a feature component from the LR original image after the LR original image passes through the feature extraction module, and transmitting the extracted feature component as an input to an iteration module, wherein the iteration module is composed of a residual network, a reconstruction network, a convolution network and a down-sampling network; and finally, performing weighted summation on the intermediate prediction HR images output by each iteration module to reconstruct a high-resolution image. A novel residual block structure is adopted, so that the convergence speed is effectively improved; an iteration module is adopted, weight summation can be directly transmitted to the iteration module in the early stage during back propagation, and convergence is guaranteed; and meanwhile, a data set is strengthened by adopting a geometric self-integration method. The result shows that compared with an existing network model, the method not only has better picture authenticity, but also has a better PNSR index and a higher model convergence training speed.

Description

technical field [0001] The invention relates to an image super-resolution reconstruction method based on a deep neural network, belonging to the technical field of image processing. Background technique [0002] An important source of information for humans is vision, so the importance of images is self-evident. In simple terms, image resolution represents the amount of information, and the amount of information can be understood as the number of pixels in a one-inch image. With the vigorous development of the era of big data, people's demand for information is getting higher and higher, and the accuracy of information is getting higher and higher. LR (Low Resolution, low resolution) images cannot meet people's specific needs, such as in the field of medical images and monitoring, how to improve image resolution has become an important issue. Due to the long improvement cycle of the manufacturing process of hardware devices and the high cost compared with software, more re...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/40G06N3/04G06N3/08
CPCG06T3/4053G06T3/4046G06N3/084G06N3/045
Inventor 曹云依杨欣陈思哲李恒锐樊江锋周大可
Owner NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products