Infrared and visible light image real-time fusion system based on heterogeneous multi-core architecture

A heterogeneous multi-core, image fusion technology, applied in image enhancement, image analysis, image data processing, etc., can solve problems such as efficiency and quality constraints

Inactive Publication Date: 2016-06-15
SICHUAN UNIV
View PDF2 Cites 32 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to design a real-time fusion system of infrared light and visible light images based on heterogeneous multi-core architecture in view of the shortcomings of the current infrared light and visible light fusion algorithm, which restricts the efficiency and quality of each other

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Infrared and visible light image real-time fusion system based on heterogeneous multi-core architecture
  • Infrared and visible light image real-time fusion system based on heterogeneous multi-core architecture
  • Infrared and visible light image real-time fusion system based on heterogeneous multi-core architecture

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] The present invention adopts the construction of a heterogeneous dual-core single CPU system based on the combination of ARM and DSP, and assigns the tasks that they are good at to different processor cores, which can effectively improve the operation and processing capacity of the system. The ARM side runs the linux operating system, uses the gcc compiler to compile the kernel driver and application program, uses Redhatlinux as the development environment, and is responsible for the real-time data collection of infrared and visible light video data and the real-time transmission of compressed data after image fusion. The video compression algorithm adopts H.264 video coding standard; running DSP / BIOSS real-time operating system on the DSP side, using CCS integrated development environment, responsible for image enhancement preprocessing of infrared images, real-time fusion of two-way video image data and real-time encoding of fused images compression.

[0057] The syst...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a real-time fusion system of infrared light and visible light images based on a heterogeneous multi-core framework. The heterogeneous multi-core processor with ARM core and DSP core as the core of the system is responsible for the control process of the whole system, data transmission and processing logic, and completes video data collection of infrared and visible light images, real-time enhancement and fusion of video data, and fusion After the display output of the video data. The ARM core is responsible for the real-time data collection of infrared light and visible light video data and the real-time transmission of the compressed data after image fusion; the DSP core is responsible for registration preprocessing and image enhancement preprocessing of infrared light input images, visible light and infrared Real-time fusion of channel video image data and real-time encoding and compression of the fused image data. Real-time fusion is performed by building a three-level Laplacian pyramid structure. The invention has the characteristics of high computing efficiency, good compatibility, strong expandability, convenient and efficient software development, strong adaptability and the like.

Description

1. Technical field [0001] The invention belongs to the field of computer application technology, relates to the fields of computer vision and information fusion, especially the field of multi-sensor image fusion, and specifically relates to a real-time fusion method of infrared light and visible light images based on a heterogeneous multi-core framework. 2. Background technology [0002] Multi-sensor image fusion technology is a new image processing technology developed on the basis of information fusion technology theory. Since the complementarity and redundancy of multi-source image information can be effectively integrated, the fused image contains richer information than any input channel image, has higher reliability, and is conducive to improving the ability to analyze and identify image information. Therefore, it has become a hot spot in the field of image processing research in international academic circles in recent years. Fusion technology maximizes the utilizati...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/50G06T3/00
CPCG06T5/50G06T3/0075G06T2207/10048G06T2207/20172
Inventor 熊伟袁学东
Owner SICHUAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products