An image super-resolution method based on a channel attention mechanism and multilayer feature fusion

A feature fusion and super-resolution technology, applied in image data processing, graphics and image conversion, instruments, etc., can solve the problem of not taking into account the different importance and limitations of feature channels, so as to improve super-resolution performance and improve expression. ability to reduce the effect of reconstruction blur

Active Publication Date: 2019-06-14
ACADEMY OF BROADCASTING SCI STATE ADMINISTATION OF PRESS PUBLICATION RADIO FILM & TELEVISION +1
View PDF5 Cites 32 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, none of these methods take into account the different importance among feature channels, or fail to make full use of hierarchical features, resulting in more limited results.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An image super-resolution method based on a channel attention mechanism and multilayer feature fusion
  • An image super-resolution method based on a channel attention mechanism and multilayer feature fusion
  • An image super-resolution method based on a channel attention mechanism and multilayer feature fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] Embodiments of the present invention will be described in further detail below in conjunction with the accompanying drawings.

[0031] In this embodiment, a 2x image super-resolution is taken as an example for illustration. An image super-resolution method based on channel attention mechanism and multi-layer feature fusion, such as Figure 1 to Figure 3 shown, including the following steps:

[0032] Step S1, at the beginning of the residual branch, directly extract the low-resolution image I through a single-layer convolutional layer based on deep learning lr The original feature U 0 .

[0033] In this step, the convolution layer size is 3×3×64.

[0034] Step S2, applying six cascaded convolutional recurrent units based on channel attention mechanism and multi-layer feature fusion to extract accurate depth features.

[0035] The specific implementation method of step S2 is as follows:

[0036] Step S2.1. At the beginning of the convolutional recurrent unit, adapti...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an image super-resolution method based on a channel attention mechanism and multilayer feature fusion, and the method comprises the steps of directly extracting the original features of a low-resolution image at the beginning of a residual branch by using a single-layer convolutional layer based on deep learning; using six cascaded convolutional circulation units based ona channel attention mechanism and multi-layer feature fusion to extract accurate depth features; carrying out upsampling on the depth features through a deconvolution layer, and carrying out dimensionality reduction on the upsampled features through a single-layer convolution layer to obtain a residual error of the high-resolution image; carrying out up-sampling on the low-resolution image by using a bicubic interpolation method in a mapping branch to obtain mapping of the high-resolution image; and adding the mapping and the residual of the high-resolution image pixel by pixel to obtain a final high-resolution image. The method is reasonable in design, fully considers the difference between the feature channels, efficiently utilizes the hierarchical features, and maintains a higher operation speed while obtaining higher accuracy.

Description

technical field [0001] The invention belongs to the technical field of computer vision images, in particular to an image super-resolution method based on channel attention mechanism and multi-layer feature fusion. Background technique [0002] With the advancement of science and technology, more and more image resolution formats have appeared in people's daily life, from "Standard Definition" (Standard Definition) to "High Definition" (High Definition), and then to the current common " 1080p", "2K" or even "4K" and so on. Higher resolution means that more image details are included, which in turn means that there may be a greater amount of information, and a greater amount of information implies greater application potential. However, in the real world, on the one hand, limited by the physical performance of imaging equipment, people cannot obtain high-resolution images; on the other hand, in Internet applications, limited by network bandwidth and storage medium capacity, u...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/40
Inventor 卢越解伟郭晓强姜竹青门爱东
Owner ACADEMY OF BROADCASTING SCI STATE ADMINISTATION OF PRESS PUBLICATION RADIO FILM & TELEVISION
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products