Image super-resolution and fusion method based on regional information enhancement and block self-attention

A technology of regional information and fusion method, applied in the field of image information processing

Active Publication Date: 2020-10-30
KUNMING UNIV OF SCI & TECH
View PDF9 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The technical problem to be solved by the present invention is to provide an image super-separation and fusion method based on region information enhancement and block self-attention to solve the problem of image fusion when the resolution of the source image is low, so as to improve the quality of the fusion result

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image super-resolution and fusion method based on regional information enhancement and block self-attention
  • Image super-resolution and fusion method based on regional information enhancement and block self-attention
  • Image super-resolution and fusion method based on regional information enhancement and block self-attention

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0036] Example 1: see figure 1 This application is a schematic diagram of the steps of the image super-division and fusion method based on region information enhancement and block self-attention. The input source image and output result image of the specific example are also drawn in this figure. by figure 1 It is known that this application is composed of source image super-resolution branch and super-resolution and fusion branch, and provides image super-division and fusion methods based on region information enhancement and block self-attention, including:

[0037] Step1. In the super-segmentation and fusion tasks of multi-focus images, such as figure 1 As shown, the low-resolution source image Respectively input into the super-resolution branch of the source image, at the same time, Spliced ​​together by channel and input into the fusion and super resolution branch. At the very beginning of the source image super-resolution branch and the fusion and super-resolution branch,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an image super-resolution and fusion method based on regional information enhancement and block self-attention, and belongs to the technical field of digital image processing.The method comprises a source image super-resolution branch and a fusion super-resolution branch. In a source image super-resolution branch, a feature extraction block is iteratively used to extracta source image feature map, and dense connections are used to fully utilize previous and subsequent feature map information. The output of each feature extraction block passes through a region information enhancement block to explore the region where each object in the source image is located, and the information assists in fusing the super-resolution branches to accurately predict the fusion decision graph. In the fusion super-resolution branch, two source images are spliced together to be input, and a fusion block based on a block self-attention mechanism is iteratively used in combination with region-enhanced source image information input in the source image super-resolution branch so as to better distinguish a focusing region from a non-focusing region. The last use of sub-pixel convolution of each branch produces a super-resolution source image and a fused image.

Description

Technical field [0001] The invention relates to an image super-division and fusion method based on area information enhancement and block self-attention, and belongs to the technical field of image information processing. Background technique [0002] The purpose of image fusion is to merge the information of two or more source images captured by different cameras in the same scene into one image, and to ensure that the information of each source image can be retained. Image fusion is widely used in security surveillance images, medical images, and satellite remote sensing images. In recent years, many studies have achieved good fusion results, but the existing methods are usually based on high-resolution multi-focus source image data sets to fuse. However, the images obtained by real imaging systems are not necessarily high Resolution image. When fusing low-resolution source images, the fused image will also be low-resolution, even fuzzy and lacking detailed information, which...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/40G06T5/50G06N3/04G06N3/08
CPCG06T3/4053G06T3/4046G06T5/50G06N3/08G06T2207/10004G06T2207/20081G06T2207/20221G06T2207/20104G06N3/045
Inventor 李华锋岑悦亮余正涛张亚飞原铭
Owner KUNMING UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap