Unlock instant, AI-driven research and patent intelligence for your innovation.

Image fusion method and system, computer readable storage medium and electronic equipment

An image fusion and image technology, applied in computing, image enhancement, image analysis and other directions, can solve problems such as unclear contrast, incomplete fusion image information, and deep learning methods do not apply fusion networks, and achieve the effect of improving quality.

Pending Publication Date: 2021-12-03
SHANDONG NORMAL UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0011] The inventors found that the following technical problems existed in the prior art: firstly, the deep learning method was not applied to the entire fusion network; secondly, the previous fusion network directly fused the data sets, and the preprocessing of the source images still remained in a simple way. In the noise stage, the final fusion image has problems such as incomplete information and unclear contrast.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image fusion method and system, computer readable storage medium and electronic equipment
  • Image fusion method and system, computer readable storage medium and electronic equipment
  • Image fusion method and system, computer readable storage medium and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0051] Such as figure 1 As shown, Embodiment 1 of the present disclosure provides an image fusion method, including the following process:

[0052] Obtain infrared images and visible light images to be processed;

[0053] Preprocessing the acquired infrared images and visible light images;

[0054] Input the preprocessed image into the preset fusion model to obtain the final fusion image;

[0055] Among them, the fusion model includes a generator and a discriminator. The generator performs feature extraction on the preprocessed infrared image and visible light image respectively, and cascades the obtained infrared image features and visible light image features to obtain the initial fusion image. The discriminator According to the obtained initial fusion image and the generator for confrontation training, the final fusion image is obtained.

[0056] In this embodiment, the overall architecture of the adversarial network based on superpixel preprocessing is as follows figure...

Embodiment 2

[0076] Embodiment 2 of the present disclosure provides an image fusion system, including:

[0077] The data acquisition module is configured to: acquire infrared images and visible light images to be processed;

[0078] The preprocessing module is configured to: preprocess the acquired infrared image and visible light image;

[0079] The image fusion module is configured to: input the preprocessed image into a preset fusion model to obtain a final fusion image;

[0080] Among them, the fusion model includes a generator and a discriminator. The generator performs feature extraction on the preprocessed infrared image and visible light image respectively, and cascades the obtained infrared image features and visible light image features to obtain the initial fusion image. The discriminator According to the obtained initial fusion image and the generator for confrontation training, the final fusion image is obtained.

[0081] The working method of the system is the same as the i...

Embodiment 3

[0083] Embodiment 3 of the present disclosure provides a computer-readable storage medium on which a program is stored, and when the program is executed by a processor, the steps in the image fusion method described in Embodiment 1 of the present disclosure are implemented.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an image fusion method and system, a computer readable storage medium and electronic equipment. The method comprises the following steps of: acquiring an infrared image and a visible light image to be processed; preprocessing the acquired infrared image and visible light image; and inputting the preprocessed images into a preset fusion model to obtain a final fused image. The fusion model comprises a generator and a discriminator; the generator carries out feature extraction on the preprocessed infrared image and visible light image and carries out cascade connection on the obtained infrared image features and visible light image features to obtain an initial fused image; and the discriminator carries out adversarial training with the generator according to the obtained initial fused image to obtain a final fused image. According to the invention, the fused image not only contains contrast information, but also contains rich texture detail information, so that the quality of the fused image is greatly improved.

Description

technical field [0001] The present disclosure relates to the technical field of image enhancement, and in particular to an image fusion method, system, computer-readable storage medium and electronic equipment. Background technique [0002] The statements in this section merely provide background information related to the present disclosure and may not necessarily constitute prior art. [0003] With the development of sensor technology, a single visible light mode has gradually developed into multiple sensor modes. Various sensors have different imaging mechanisms, different working wavelength ranges, different working environments and requirements, and perform different functions. Due to the various limitations of the sensor's own physical characteristics, imaging mechanism, and viewing angle, a single image sensor is often unable to extract enough information from the scene, so that it is difficult or even impossible to obtain a comprehensive description of a scene indep...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/50G06N3/04G06N3/08
CPCG06T5/50G06N3/08G06T2207/10048G06T2207/20081G06T2207/20084G06T2207/20221G06N3/045
Inventor 王晶晶张波任金雯
Owner SHANDONG NORMAL UNIV