Multi-modality image fusion method based on region and human eye contrast sensitivity characteristic

Abstract

The invention provides a multi-modality image fusion method based on a region and human eye contrast sensitivity characteristic, comprising the following steps of: (1) respectively utilizing a non-subsampled Contourlet transform NSCT to carry out multi-scale decomposition on a source image to be fused to obtain each stage of sub-band coefficient of the source image; (2) respectively formulating a fusion rule of a low-frequency sub-band coefficient and each stage of high-frequency sub-band coefficient according to a human eye vision contrast function LCSF, a human eye vision absolute contrast sensitivity function ACSF, a feeling brightness contrast function FBCS and a local average gradient sensitivity function LGSF to obtain each grade of the sub-band coefficient of a fused image; and (3) carrying out NSCT inverted conversion on the fused coefficient and reconstructing to obtain the fused image. The multi-modality image fusion method disclosed by the invention meets vision properties of a human eye and improves the quality of the fused image to a great extent; and the multi-modality image fusion method has robustness, is suitable for fusing a plurality of types of image sources of infrared and visible light images, multi-focusing images, remote images and the like, and has a wide application prospect.

Description

technical field [0001] The invention belongs to the field of fusion of heterogeneous images and videos, and in particular relates to the fusion of heterogeneous images based on non-subsampled Contourlet transform NSCT, which is mainly used for the fusion of heterogeneous images such as infrared images, visible light images, multi-focus images, and remote sensing images. A Heterogeneous Image Fusion Method Based on Region and Contrast Sensitivity Characteristics of Human Eye. Background technique [0002] With the rapid development of computer science and sensor technology, more and more sensors are applied in various fields. From a single visible light mode to a variety of sensor modes, various sensors have different imaging mechanisms, work in different wavelength ranges, and meet the needs of different working environments. In order to meet more practical applications, multi-sensor information fusion technology emerged as the times require. [0003] Heterogeneous image f...

AI Technical Summary

Problems solved by technology

For example, low light, smog, etc. will reduce the image quality or even make it impossible to see the target clearly, while the image obtained by the millimeter wave radar has a strong penetrating ability for low light, smog, etc., and the infrared camera completely ignores the existence of harsh environments. Receive the infrared signal of the object, although the signal is attenuated, but still can get a relatively clear image

Images