Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Fusion method of visible light and infrared image based on udct and pcnn

An infrared image and visible light technology, applied in the field of fusion of visible light and infrared images, can solve the problems of not being able to judge the richness of the source image details, not being able to judge the image to be fused, and the fused image being unclear, so as to eliminate the Gibbs block effect, enhance visual presentation, and reduce noise

Active Publication Date: 2019-03-12
SICHUAN UNIV
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of the above-mentioned prior art, the purpose of the present invention is to provide a fusion method of visible light and infrared images based on UDCT and PCNN, which solves the problems of the prior art due to the inability to judge the similarity of the low-frequency information of the image to be fused and the inability to judge the richness of details of the source image. The resulting fusion image is not clear, the details are not obvious and other technical problems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Fusion method of visible light and infrared image based on udct and pcnn
  • Fusion method of visible light and infrared image based on udct and pcnn
  • Fusion method of visible light and infrared image based on udct and pcnn

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0043] In view of the excellent performance of UDCT transformation, this paper applies it to the fusion method of infrared and visible light images. This algorithm can be summarized as the following three steps:

[0044] (1) After decomposing the source images of the visible light image and the infrared image through UDCT transformation, the UDCT subband coefficients of different scales and directions can be obtained. It contains low frequency and high frequency UDCT coefficients.

[0045](2) Use different methods to fuse each scale layer according to specific rules, that is, use low-frequency coefficient fusion rules for low-frequency coefficients, and use high-frequency coefficient fusion rules to process high-frequency coefficients, and finally obtain the fused UDCT of each layer coefficient.

[0046] (3) The reconstructed image obtained by inverse transforming the fused UDCT coefficients of each layer is the fused image.

[0047] Fusion rules adopted by the algorithm

...

Embodiment 2

[0088] In order to verify the effectiveness of the algorithm, the experiment uses two sets of registered infrared and visible light images of the same scene. Experimental images such as figure 2 shown. The method proposed by the present invention is compared with the method based on wavelet transform, the method based on non-subsampling wavelet transform, the method based on Contourlet transform, the method based on UDCT transform and the method based on generalized random walk. In the experiment, both wavelet transform and non-subsampling wavelet transform use 3-layer decomposition, and use Harr wavelet basis function, use the maximum coefficient rule to fuse high-frequency coefficients, and use the average rule to fuse low-frequency coefficients.

[0089] Applying different fusion methods to the figure 2 The experimental results of the Chinese ship image are as follows: image 3 shown. image 3 (a) and image 3 (b) Infrared image and visible light image of the ship, r...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a visible light and infrared image fusion algorithm based on UDCT (Uniform Discrete Curvelet Transform) and a PCNN (Pulse Coupled Neural Network), which relates to the technical field of image processing and solves the technical problems that the fused image is not clear and details are unobvious as the similarity of low-frequency information of a to-be-fused image can not be judged in the prior art, and the detail richness degree of a source image can not be judged. The algorithm of the invention mainly comprises steps: (1) after source images of the visible light image and the infrared image are subjected to UDCT decomposition, UDCT subband coefficients with different scales in different directions can be obtained, and the UDCT subband coefficients comprise low-frequency and high-frequency UDCT coefficients; and (2) according to a specific rule, a different mode is adopted for each scale layer for fusion processing, a low-frequency coefficient fusion rule is adopted for the low-frequency coefficients, a high-frequency coefficient fusion rule is adopted for the high-frequency coefficients, and finally, the UDCT coefficient for each layer after fusion can be acquired; and a reconstructed image obtained after inverse transforma on the UDCT coefficient for each layer after fusion is the fused image.

Description

technical field [0001] The invention relates to the technical field of image processing, in particular to a fusion method of visible light and infrared images based on UDCT and PCNN. Background technique [0002] At present, using the fusion technology of visible light and infrared images to improve the quality of infrared images is a research hotspot in the field of infrared image enhancement, and multi-scale fusion technology is the mainstream research direction in this hotspot. The principle of multi-scale fusion technology is as follows: In the first step, the source image is decomposed into a series of sub-images through multi-scale transformation, and these sub-images have different scales, frequency and spatial characteristics. In the second step, fusion calculation is performed on the transformation coefficients of the source image according to specific fusion rules. In the third step, the fused transformation coefficients are inversely transformed by multi-scale de...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T5/50
CPCG06T5/50G06T2207/10048G06T2207/20064G06T2207/20084G06T2207/20221
Inventor 何小海甘炜吴晓红
Owner SICHUAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com