Multi-modality image fusion method based on region and human eye contrast sensitivity characteristic

Abstract

The heterosource image fusion method based on the contrast sensitivity characteristics of the region and the human eye includes the following steps: (1) The source images to be fused are multi-scale decomposed using the non-subsampled Contourlet transform NSCT to obtain the sub-band coefficients of each order of the source image; (2) According to the human visual contrast function LCSF, the human visual absolute contrast sensitivity function ACSF, the perceived brightness contrast function FBCF and the local average gradient sensitivity function LGSF, the fusion rules for the low-frequency sub-band coefficients and the high-frequency sub-band coefficients at all levels are respectively formulated. , obtain the sub-band coefficients of each level of the fused image; (3) Perform NSCT inverse transformation on the fused coefficients, and reconstruct the fused image. The invention conforms to the visual characteristics of the human eye, greatly improves the quality of the fused image, is robust, is suitable for the fusion of infrared and visible light images, multi-focus images, remote sensing images and other image sources, and has broad application prospects.

Description

technical field [0001] The invention belongs to the field of fusion of heterogeneous images and videos, and in particular relates to the fusion of heterogeneous images based on non-subsampled Contourlet transform NSCT, which is mainly used for the fusion of heterogeneous images such as infrared images, visible light images, multi-focus images, and remote sensing images. A Heterogeneous Image Fusion Method Based on Region and Contrast Sensitivity Characteristics of Human Eye. Background technique [0002] With the rapid development of computer science and sensor technology, more and more sensors are applied in various fields. From a single visible light mode to a variety of sensor modes, various sensors have different imaging mechanisms, work in different wavelength ranges, and meet the needs of different working environments. In order to meet more practical applications, multi-sensor information fusion technology emerged as the times require. [0003] Heterogeneous image f...

AI Technical Summary

Problems solved by technology

For example, low light, smog, etc. will reduce the image quality or even make it impossible to see the target clearly, while the image obtained by the millimeter wave radar has a strong penetrating ability for low light, smog, etc., and the infrared camera completely ignores the existence of harsh environments. Receive the infrared signal of the object, although the signal is attenuated, but still can get a relatively clear image

Images