Infrared and visible light image fusion method based on generative confrontation network

An image fusion and infrared image technology, which is applied in the field of infrared and visible light image fusion, can solve the problems of difficult new breakthroughs in the field of infrared and visible light images, and are no longer conspicuous, so as to facilitate detection and recognition, conspicuous targets, and rich texture information Effect

Active Publication Date: 2021-11-16
WUHAN UNIV
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, these methods all use the same strategy to select the same salient features in the infrared image and the visible light image for fusion, so that the target that was originally salient in the infrared image is no longer salient in the visible light image.
At the same time, these methods have to manually design fusion features and fusion rules, making it difficult to make new breakthroughs in the field of infrared and visible light images.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Infrared and visible light image fusion method based on generative confrontation network
  • Infrared and visible light image fusion method based on generative confrontation network
  • Infrared and visible light image fusion method based on generative confrontation network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0029] The invention discloses an infrared and visible light image fusion method based on a generative confrontation network. The infrared image and the visible light image are simultaneously input into a generator in the generative confrontation network, and the generator performs image fusion operation and outputs a final fusion image. The invention provides the network structure design of the generator and the decision device in the generation confrontation network, the design of the loss function of the generator and the decision device, and the training and testing of the generation confrontation network.

[0030] The Generative Adversarial Network includes a generator and arbitrator The present invention sets the generator and the decision device as a convolutional neural network, and realizes automatic learning of fusion features and fusion ru...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an infrared and visible light image fusion method based on a generative confrontation network. The network realizes automatic learning of fusion features and fusion rules in the process of training the convolutional neural network; infrared images and visible light images are simultaneously input to the generator in the generation confrontation network, and the generator performs image fusion operations and outputs the final fusion image. The present invention breaks through the limitations of manual design of fusion features and rules, and uses the generator in the generation confrontation network to automatically learn fusion features and rules, and the fusion image generated by the present invention can well maintain the basic radiation information of infrared images, and has Rich texture information, while the fusion image has good visual effect and high target salience.

Description

technical field [0001] The present invention relates to the technical field of infrared image fusion, in particular, the present invention relates to a technical proposal for fusion of infrared and visible light images based on a generative confrontation network. Background technique [0002] The infrared imaging system has strong anti-interference ability, good concealment performance, strong atmospheric penetration ability, obvious target, and can adapt to many special occasions. However, due to the characteristics of the infrared detector itself, such as high sensitivity and large dynamic range, as well as various noise interference in the complex working environment, the infrared image shows the characteristics of high background and low contrast. The specific performance is that the imaging scene only accounts for a small part of the dynamic range of the entire infrared imaging system, and the image contrast is poor and blurred. On the contrary, the visible light image...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06T5/50G06T3/00
CPCG06T3/0068G06T5/50G06T2207/10048G06T2207/20221
Inventor 马佳义马泳黄珺梅晓光
Owner WUHAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap