A kind of image fusion method and device of depth image and infrared image

Abstract

An image fusion method of a depth image and an infrared image, comprising the following steps: (1) obtaining an infrared image and a depth image respectively by an infrared sensor and a TOF depth sensor; (2) extracting a scene, a target object and even a scene based on depth information in the depth image The edge contour information of each component of the object; (3) The depth image and the infrared image that have completed the registration operation are decomposed at multiple scales with the same parameters to obtain image expressions of different scales; (4) The detailed information representing the source image Select an appropriate fusion rule for the high-frequency component to determine the fusion coefficient, and select an appropriate fusion rule for the low-frequency component representing the contour information of the source image to determine the fusion coefficient; (5) process the fused coefficient through the corresponding multi-scale inverse transformation, and combine it with the edge contour The information is fused to obtain a fused image. In practical application, this method is less affected by visible light intensity and has strong environmental adaptability.

Description

technical field [0001] The invention belongs to the field of image processing, and in particular relates to an image fusion method and device for a depth image and an infrared image. Background technique [0002] Due to the imaging characteristics and limitations of a single image sensor, it is difficult to complete tasks such as detection, tracking, and reconnaissance under different imaging conditions and background environments. Therefore, image fusion technology uses information complementarity between sensors to integrate the characteristics of the two images, which can highlight target temperature information or depth information and enhance scene understanding. It has become a research hotspot in information fusion technology. [0003] In the prior art, there is a method for fusing visible light panchromatic images and infrared remote sensing images, which discloses a multi-scale and multi-level method for fusing visible light panchromatic images and infrared remote s...

AI Technical Summary

Problems solved by technology

[0006] Infrared and visible light image fusion technology utilizes information complementarity between sensors and combines the characteristic information of the two images. Although it can highlight infrared targets and enhance scene understanding, it cannot obtain the depth information of the scene.

[0007] There are not many existing depth image and visible light image fusion technologies. There is only one patent for foreground detection method that uses the depth image and visible light image fusion, but only uses the probability and statistics indicators of the depth information in the depth image, and does not The image after the fusion of the depth image and the visible light image has not been finally obtained, and the temperature information of the scene cannot be obtained, and the infrared image does not have a good ability to identify camouflage

Images