Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Infrared and visible light image real-time fusion system based on heterogeneous multi-core architecture

A heterogeneous multi-core, image fusion technology, applied in image enhancement, image analysis, image data processing, etc., can solve problems such as efficiency and quality constraints

Inactive Publication Date: 2016-06-15
SICHUAN UNIV
View PDF2 Cites 32 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to design a real-time fusion system of infrared light and visible light images based on heterogeneous multi-core architecture in view of the shortcomings of the current infrared light and visible light fusion algorithm, which restricts the efficiency and quality of each other

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Infrared and visible light image real-time fusion system based on heterogeneous multi-core architecture
  • Infrared and visible light image real-time fusion system based on heterogeneous multi-core architecture
  • Infrared and visible light image real-time fusion system based on heterogeneous multi-core architecture

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] The present invention adopts the construction of a heterogeneous dual-core single CPU system based on the combination of ARM and DSP, and assigns the tasks that they are good at to different processor cores, which can effectively improve the operation and processing capacity of the system. The ARM side runs the linux operating system, uses the gcc compiler to compile the kernel driver and application program, uses Redhatlinux as the development environment, and is responsible for the real-time data collection of infrared and visible light video data and the real-time transmission of compressed data after image fusion. The video compression algorithm adopts H.264 video coding standard; running DSP / BIOSS real-time operating system on the DSP side, using CCS integrated development environment, responsible for image enhancement preprocessing of infrared images, real-time fusion of two-way video image data and real-time encoding of fused images compression.

[0057] The syst...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an infrared and visible light image real-time fusion system based on a heterogeneous multi-core architecture. The system uses a heterogeneous multi-core processor, with an ARM core and a DSP core as cores, to take charge of the control flow and the data sending and receiving and processing logic of the whole system, complete video data collection and real-time enhancing and fusion of infrared and visible light images, and display and output the video data after fusion. The ARM core is responsible for real-time data collection of both infrared light and visible light video data and real-time transmission of compressed data after image fusion. The DSP core is responsible for registration preprocessing and image enhancement preprocessing of the infrared light input image, real-time fusion of the infrared light and visible light video data, and real-time encoding compression of the video data after fusion. A three-layer Laplacian pyramid structure is used for the real-time fusion. The system is high in computation efficiency, good in compatibility, high in extensibility and adaptability, and convenient and highly efficient in software developing.

Description

1. Technical field [0001] The invention belongs to the field of computer application technology, relates to the fields of computer vision and information fusion, especially the field of multi-sensor image fusion, and specifically relates to a real-time fusion method of infrared light and visible light images based on a heterogeneous multi-core framework. 2. Background technology [0002] Multi-sensor image fusion technology is a new image processing technology developed on the basis of information fusion technology theory. Since the complementarity and redundancy of multi-source image information can be effectively integrated, the fused image contains richer information than any input channel image, has higher reliability, and is conducive to improving the ability to analyze and identify image information. Therefore, it has become a hot spot in the field of image processing research in international academic circles in recent years. Fusion technology maximizes the utilizati...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/50G06T3/00
CPCG06T5/50G06T2207/20172G06T2207/10048G06T3/147
Inventor 熊伟袁学东
Owner SICHUAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products