Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Single-image super-resolution reconstruction algorithm based on multi-scale residual error learning network

A learning network, multi-scale technology, applied in the field of image processing, can solve the problems of increasing computational complexity and memory consumption

Pending Publication Date: 2019-09-03
TIANJIN POLYTECHNIC UNIV
View PDF7 Cites 27 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In order to obtain better reconstruction results, the depth and width of the network are continuously increased, which greatly increases the computational complexity and memory consumption

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Single-image super-resolution reconstruction algorithm based on multi-scale residual error learning network
  • Single-image super-resolution reconstruction algorithm based on multi-scale residual error learning network
  • Single-image super-resolution reconstruction algorithm based on multi-scale residual error learning network

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment approach

[0012] A single image super-resolution reconstruction algorithm based on a multi-scale residual learning network, such as figure 1 As shown, it mainly consists of three parts: feature extraction block (FBlock), multi-scale information block (MFBlock) and reconstruction block (RBlock). Y and X represent the input and output of the MFN network, respectively.

[0013] A. Feature extraction block (FBlock)

[0014] A feature extraction block consisting of two layers of 3×3 convolutions extracts a feature map F from the original low-resolution image Y 0 , as shown in formula (1):

[0015] f 0 = f et (Y) (1)

[0016] In formula (1), f et Indicates the feature extraction function, F 0 Represents the feature channel extracted by two layers of convolution and sent to the first multi-scale information block, assuming that n multi-scale information blocks are stacked as the mapping process of residual information, this process is shown in formula (2):

[0017] f k =D k (F k-1 ),...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a single-image super-resolution reconstruction algorithm based on a multi-scale residual error learning network. In recent years, the convolutional neural network is widely applied to many visual tasks, and particularly, remarkable results are obtained in the field of single-image super-resolution reconstruction. Similarly, multi-scale feature extraction also achieves consistent performance improvement in the field. However, in the prior art, multi-scale features are extracted in a layered mode mostly, and with the increase of the depth and width of a network, the calculation complexity and the consumption of a memory can be greatly improved. In order to solve the problem, the invention provides a compact multi-scale residual error learning network, i.e., representing multi-scale characteristics in a residual error block. The model is composed of a feature extraction block, a multi-scale information block and a reconstruction block. In addition, due to the factthat the number of network layers is small and group convolution is used, the network has the advantage of being high in execution speed. Experimental results show that the method is superior to an existing method in time and performance.

Description

technical field [0001] The invention relates to the technical field of image processing, in particular to a single image super-resolution reconstruction algorithm based on a multi-scale residual learning network. Background technique [0002] Image super-resolution reconstruction, especially single image reconstruction, has attracted more and more attention. The main task of super-resolution reconstruction is to reconstruct high-resolution images from low-resolution images with reasonable priors. It is worth noting that this is an ill-posed problem, because there may be different mapping relationships between high-resolution and low-resolution images. Therefore, these specific mapping relationships need to be obtained by learning from large image datasets. Traditional methods based on external examples can effectively solve this problem, that is, learning compact dictionaries or manifold spaces from external datasets to represent this mapping relationship, such as nearest ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T5/00
CPCG06T5/00G06T2207/20084G06T2207/20081
Inventor 杨亚楠王庆成李楠
Owner TIANJIN POLYTECHNIC UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products