Deep attention coding and decoding single-image super-resolution algorithm based on perception loss guidance

A technology of super-resolution and attention, applied in image data processing, graphics and image conversion, computing, etc., can solve problems such as limiting the applicability of methods, difficulty in collecting HR images, and inability to obtain them, so as to achieve excellent visual effects and reconstruction The effect of high efficiency and quality improvement

Active Publication Date: 2020-07-10
NANJING UNIV OF INFORMATION SCI & TECH
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, most deep learning methods belong to the supervised learning method. These methods require a large number of image pairs, consisting of LR images and corresponding HR images, to pre-train network parameters, which limits the applicability of these methods in actual scenarios.
In some practical problems, it is difficult to collect real HR images, and there are even cases where they cannot be obtained

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Deep attention coding and decoding single-image super-resolution algorithm based on perception loss guidance
  • Deep attention coding and decoding single-image super-resolution algorithm based on perception loss guidance
  • Deep attention coding and decoding single-image super-resolution algorithm based on perception loss guidance

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] In order to make the object, technical solution and effect of the present invention more clear and definite, the present invention will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0037] refer to figure 1 , this embodiment provides a deep attention codec single image super-resolution algorithm based on perceptual loss guidance, including:

[0038] S1: Construct a deep attention encoding and decoding network model guided by perceptual loss;

[0039] Specifically: build a network model that introduces a residual spatial attention mechanism. The network is mainly composed of an encoder and a decoder. The codec is in a series form. The input passes through the encoder and then the decoder outputs the target image. There is also a residual connection between codecs at th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a deep attention coding and decoding single-image super-resolution algorithm based on perception loss guidance. The deep attention coding and decoding single-image super-resolution algorithm comprises the following steps: constructing a deep attention coding and decoding network model based on perception loss guidance; designing a perception loss objective function accordingto the network model; presetting network model hyper-parameters, and training a network model by adopting a back propagation algorithm according to the perception loss objective function; if the network model converges, outputting an expected high-resolution image, otherwise, returning to execute the previous step until the network model converges. According to the invention, the residual space attention unit is added into the network and is used for capturing and reconstructing more low-frequency information; the perceptual loss composed of an average absolute error and structural similarityloss is used as a loss function to optimize network parameters, so that the network can pay more attention to the visual sensitive area to store the visual information structure, the quality of the reconstructed image is improved, the reconstructed image has an excellent visual effect, and the reconstruction efficiency of the network is extremely high.

Description

technical field [0001] The invention belongs to the technical field of image information processing, and in particular relates to a deep attention encoding and decoding single image super-resolution algorithm guided by perceptual loss. Background technique [0002] Image super-resolution is to convert low-resolution images to high-resolution through certain algorithms. High-resolution images have higher pixel density, more detailed information, and more delicate picture quality. To obtain high-resolution images, the most direct way is to use high-resolution cameras. However, in practical applications, due to the consideration of manufacturing process and engineering costs, high-resolution and super-resolution cameras will not be used in many occasions. A camera is used to collect image signals. [0003] The concept and method of super-resolution technology was first proposed by Harris and Goodman in the 1960s. Subsequently, many people have studied it, and have proposed m...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/40G06N3/08
CPCG06T3/4053G06T3/4046G06N3/084Y02T10/40
Inventor 孙玉宝施羽旸周旺平赵丽玲
Owner NANJING UNIV OF INFORMATION SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products