Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Infrared and visible image fusion method based on generated countermeasure network

A technology of image fusion and visible light, which is applied in the field of infrared and visible light image fusion, can solve the problems that are no longer conspicuous and difficult to make new breakthroughs in the field of infrared and visible light images, and achieve remarkable goals, which are conducive to detection and recognition, and enrich texture information. Effect

Active Publication Date: 2019-01-01
WUHAN UNIV
View PDF3 Cites 33 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, these methods all use the same strategy to select the same salient features in the infrared image and the visible light image for fusion, so that the target that was originally salient in the infrared image is no longer salient in the visible light image.
At the same time, these methods have to manually design fusion features and fusion rules, making it difficult to make new breakthroughs in the field of infrared and visible light images.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Infrared and visible image fusion method based on generated countermeasure network
  • Infrared and visible image fusion method based on generated countermeasure network
  • Infrared and visible image fusion method based on generated countermeasure network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0029] The invention discloses an infrared and visible light image fusion method based on a generative confrontation network. The infrared image and the visible light image are simultaneously input into a generator in the generative confrontation network, and the generator performs image fusion operation and outputs a final fusion image. The invention provides the network structure design of the generator and the decision device in the generation confrontation network, the design of the loss function of the generator and the decision device, and the training and testing of the generation confrontation network.

[0030] The Generative Adversarial Network includes a generator and arbitrator The present invention sets the generator and the decision device as a convolutional neural network, and realizes automatic learning of fusion features and fusion ru...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an infrared and visible light image fusion method based on a generation countermeasure network, the invention is characterized in that: a generating antagonistic network is established; the generating antagonistic network comprises a generator and a decider; the generator and the decider are arranged as a convolution neural network; and the fusion characteristics and the fusion rules are automatically learned in the process of training the convolution neural network; The infrared image and the visible image are simultaneously input to generate the generator in the countermeasure network. The generator performs image fusion operation and outputs the final fusion image. The invention breaks through the limitation of fusion features and rules of manual design, the fused image generated by the invention can well keep the basic radiation information of the infrared image and has abundant texture information, meanwhile, the visual effect of the fused image is good andthe saliency of the target is high.

Description

technical field [0001] The present invention relates to the technical field of infrared image fusion, in particular, the present invention relates to a technical proposal for fusion of infrared and visible light images based on a generative confrontation network. Background technique [0002] The infrared imaging system has strong anti-interference ability, good concealment performance, strong atmospheric penetration ability, obvious target, and can adapt to many special occasions. However, due to the characteristics of the infrared detector itself, such as high sensitivity and large dynamic range, as well as various noise interference in the complex working environment, the infrared image shows the characteristics of high background and low contrast. The specific performance is that the imaging scene only accounts for a small part of the dynamic range of the entire infrared imaging system, and the image contrast is poor and blurred. On the contrary, the visible light image...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/50G06T3/00
CPCG06T5/50G06T2207/20221G06T2207/10048G06T3/14
Inventor 马佳义马泳黄珺梅晓光
Owner WUHAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products