Multi-sensor fusion low-illumination video image enhancement method

A multi-sensor fusion, video image technology, applied in image enhancement, image analysis, image data processing and other directions, can solve problems such as poor real-time performance, low registration accuracy of heterogeneous multi-scale video images, and inaccurate fusion.

Active Publication Date: 2016-07-27
CHANGCHUN UNIV OF SCI & TECH
View PDF7 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The invention provides a low-illuminance video image enhancement method based on multi-sensor fusion to solve the problems of low registration accuracy, poor real-time performance, and inaccurate fusion of heterogeneous and multi-scale video images, and improve the visibility of video images in low-illuminance environments , realizing the real-time fusion of heterogeneous and multi-scale video images, which not only retains the rich color information of visible light images, but also increases the information of infrared images, improving the quality of video images

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-sensor fusion low-illumination video image enhancement method
  • Multi-sensor fusion low-illumination video image enhancement method
  • Multi-sensor fusion low-illumination video image enhancement method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0067] Include the following steps:

[0068] 1. In the case that the infrared imaging sensor and the visible light imaging sensor are fixed and collected at the same time, a set of infrared video and visible light video is collected, and the size of the infrared video is 576*704, such as Figure 2a As shown, the size of visible light video is 640*480, such as Figure 2b shown;

[0069] 2. Image preprocessing

[0070] Since the imaging principle of infrared images is based on the radiant energy of the object to the camera, the imaging principle of visible light is based on the reflected energy of the object to the camera. Therefore, to enhance the infrared image, the method adopted here is to invert each pixel of the infrared image, and define a 576×704 unit matrix E, and the specific implementation is as formula (1);

[0071] im1=255*E-im1(1)

[0072] The infrared image after inversion is smoothed by means of difference filtering. The main reason is that infrared images a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a multi-sensor fusion low-illumination video image enhancement method and belongs to the video image processing field. According to the method, matching is carried out according to characteristic similarities between videos from different sources; registration is performed on images from different sources by adopting a multi-scale SIFT algorithm; an accurate transformation matrix can be obtained based on the combination of the multi-scale SIFT algorithm and a RANSAC algorithm; the transformation matrix is utilized to perform interpolation on each frame in infrared video images and visible light video images, and therefore, images with different resolutions can be transformed into images with the same resolution, and problems in the registration of images with different resolutions can be solved; and fast fusion of the images is realized by using an alpha-based weighting algorithm, the fusion time of the images satisfies the real-time requirement of the videos, and therefore, real-time display of the videos can be realized. With the multi-sensor fusion low-illumination video image enhancement method adopted, the definition of the videos can be improved, and information contained by the clear videos is also rich and colorful, and follow-up processing can be facilitated.

Description

technical field [0001] The invention belongs to the field of video image processing. Background technique [0002] Visible light videos taken in low-light environments have low visibility, and people cannot identify specific scenes and people based on the videos. This has brought inconvenience to many fields such as military affairs, medicine, civilian use, so the research of this technology has important effect. Low-light video image enhancement technology can be used in military navigation monitoring systems, or frontier night vision systems and applications of remote sensing images; in the medical field, it can be used to detect human cells or blood vessels, and then analyze the physical condition of the human body ; The application in the field of life is even more extensive, and can be used in the night shooting system of mobile phones, the monitoring system of shopping malls, the application of artificial intelligence (clear video is conducive to the identification an...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/00G06T5/50G06T3/00G06T3/40G06T7/00
CPCG06T3/0068G06T3/4038G06T5/002G06T5/50
Inventor 朴燕王钥
Owner CHANGCHUN UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap