Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A multi-sensor image fusion method and system based on GDGF

An image fusion, multi-sensor technology, applied in image enhancement, image analysis, image data processing, etc., can solve problems such as the inability to effectively extract the edge texture information of the source image, the incomplete representation of the details of the fusion image, and the inaccurate determination of the focus area. , to achieve the effect of improving subjective and objective quality, easy implementation, and improving spatial consistency

Active Publication Date: 2019-03-22
LUOYANG NORMAL UNIV
View PDF5 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

It overcomes the inaccurate determination of the focus area in multi-sensor image fusion, the inability to effectively extract the edge texture information of the source image, the incomplete characterization of the details of the fusion image, the loss of some details, the "block effect", and the decrease in contrast, etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A multi-sensor image fusion method and system based on GDGF
  • A multi-sensor image fusion method and system based on GDGF
  • A multi-sensor image fusion method and system based on GDGF

Examples

Experimental program
Comparison scheme
Effect test

Embodiment example 1

[0070] Following the scheme of the present invention, this implementation case 1 is figure 2 The two source images shown in (a) and (b) are fused, and the processing results are as follows image 3 Shown in Propose. At the same time, using Laplacian (LAP), wavelet transform (DWT), non-subsampling-based contourlet transform (NSCT), cartoon texture image decomposition (CTD), gradient-based multi-scale weight (MWGF), and multi-visual features ( MVFMF), guided filtering (GFF) and seven image fusion methods figure 2 The two source images shown in (a) and (b) are fused, and the quality of the fused images of different fusion methods is evaluated, and the results are shown in Table 1.

[0071] Table 1 Multi-sensor image 'Balloon' fusion image quality evaluation.

[0072]

[0073]

Embodiment example 2

[0075] Following the scheme of the present invention, this implementation case is Figure 4 The two source images shown in (a) and (b) are fused, and the processing results are as follows Figure 5 Shown in Proposed.

[0076] Simultaneous Laplacian (LAP), wavelet transform (DWT), non-subsampling-based contourlet transform (NSCT), cartoon texture image decomposition (CTD), gradient-based multiscale weighting (MWGF), multi-visual feature-based (MVFMF) ), guided filtering (GFF) and eight image fusion methods Figure 4 The two source images shown (a) and (b) are fused, and the Figure 5 The quality of the fused images of different fusion methods is evaluated, and the results shown in Table 2 are processed and calculated.

[0077] Table 2 Multi-sensor image fusion image quality evaluation of 'Book'.

[0078]

[0079] Simultaneous Laplacian (LAP), wavelet transform (DWT), non-subsampling-based contourlet transform (NSCT), cartoon texture image decomposition (CTD), gradient-ba...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of optical sensor image processing, and discloses a multi-sensor image fusion method and a system based on gradient domain guiding filter. The method smoothes a source image by using a mean filter, removes a small structure in the source image, and decomposes the source image to obtain a base layer and a detail layer of the source image. Laplace high-pass filter and Gaussian low-pass filter are used to filter the source image, and the salient image is obtained. The weight map of the corresponding source image is obtained by comparing the salient pixel size of the source image. The source image is used as the guide image and the weight map is decomposed by GDGF to get the basic layer and the detail layer of the weight map respectively. Accordingto certain fusion rules, the pixels corresponding to the base layer and the detail layer are fused by using the optimized weight map base layer and the detail layer, and the fused base layer and the detail layer are merged to obtain the fused image. The invention can effectively save the detail information in the source image, greatly improves the subjective and objective quality of the fused image, and has robustness to image registration.

Description

technical field [0001] The invention belongs to the technical field of optical sensor image processing, and designs a multi-sensor image fusion method, in particular to a multi-sensor image fusion method and system based on GDGF (Gradient Domain Guided Filtering, GDGF). Background technique [0002] With the rapid development of high-performance sensing equipment technology, there are more and more ways and types of images for human beings to obtain. Due to the limitation of depth of field, the optical sensor imaging system can only clearly image the in-focus target on the image plane, while the out-of-focus target is blurred, making it impossible to clearly image all the targets in the scene at one time. At present, remote sensing, medical imaging, and military survey fields all need to understand the entire scene target, but they need to analyze a large number of different scene target images in the same scene, resulting in a huge waste of time, space and energy. Through ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/50
CPCG06T5/50G06T2207/20221
Inventor 张永新王莉马友忠贾世杰蒋琳
Owner LUOYANG NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products