Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Infrared and visible light fusion method

A fusion method and visible light technology, applied in the fields of image processing and computer vision, can solve problems such as easy halo artifacts, failure to consider multi-scale image detail information, loss of image details, etc., to make up for the loss of details and improve pan Effects of characterization, enhancement, and discrimination

Active Publication Date: 2020-04-28
DALIAN UNIV OF TECH
View PDF5 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In recent years, most of the fusion methods are researched and designed based on the transformation domain, without considering the multi-scale details of the image, resulting in the loss of details in the fused image, such as the public patent CN208240087U [Chinese] an infrared and visible light fusion system and image fusion device
Traditional multi-scale transformations are mainly composed of linear filters, which are prone to halo artifacts during the decomposition process

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Infrared and visible light fusion method
  • Infrared and visible light fusion method
  • Infrared and visible light fusion method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] The present invention proposes a method for real-time image fusion using an infrared camera and a visible light camera, which is described in detail in conjunction with the drawings and embodiments as follows:

[0023] Place the binocular stereo camera on a fixed platform. In this embodiment, the image resolution of the camera is 1280×720, and the field of view is 45.4°; the experimental platform is as figure 1 As shown, in order to ensure real-time performance, NVIDIA TX2 is used for calculation. On this basis, a fusion method of infrared and visible light is provided, and the method comprises the following steps:

[0024] 1) Acquire the registered infrared and visible light images

[0025] 1-1) Carry out the calibration of each lens and the joint calibration of their respective systems for the visible light binocular camera and the infrared binocular camera respectively;

[0026] 1-2) Using Zhang Zhengyou’s calibration method to calibrate each infrared binocular cam...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an infrared and visible light fusion method, and belongs to the field of image processing and computer vision. The invention adopts a pair of infrared binocular camera and visible light binocular camera to obtain images, relates to construction of a fusion image pyramid and a visual saliency enhancement algorithm, and is an infrared and visible light fusion algorithm utilizing multi-scale transformation. According to the invention, the binocular cameras and NVIDIATX2 are utilized to construct a high-performance operation platform, and a high-performance solving algorithmis constructed to obtain a high-quality infrared and visible light fusion image. According to the invention, different principles of infrared and visible light camera imaging are utilized, an image pyramid is constructed by designing a filtering template, image super-resolution and significant enhancement are carried out after image information under different scales is obtained, and finally real-time performance is achieved through GPU acceleration. The system is easy to construct, and input data acquisition can be completed by using the infrared stereo binocular camera and the visible lightstereo binocular camera respectively; and program is simple and easy to implement.

Description

technical field [0001] The invention belongs to the field of image processing and computer vision, adopts a pair of infrared cameras and visible light cameras to obtain images, relates to constructing fusion image pyramids and visually significant enhancement algorithms, and is an infrared and visible light fusion algorithm using multi-scale transformation. Background technique [0002] The development of binocular stereo vision technology based on visible light band is relatively mature. Visible light imaging has rich contrast, color, and shape information, so it can accurately and quickly obtain matching information between binocular images, and then obtain scene depth information. However, imaging in the visible light band has its defects. For example, in strong light, fog, rain, snow or night, the imaging quality is greatly reduced, which affects the matching accuracy. Therefore, using the complementarity of information sources in different bands to establish a color fus...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T7/90G06T7/80G06T7/32G06T5/50G06T5/00
CPCG06T7/90G06T7/80G06T7/32G06T5/50G06T2207/20016G06T2207/20221G06T5/77G06T3/4053G06T5/20G06T2207/10024G06T2207/10048G06T2207/20164G06T5/94G06T7/30G06T5/10
Inventor 刘日升樊鑫刘晋源仲维罗钟铉
Owner DALIAN UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com