Target recognition and tracking system based on multi-source video integration

Abstract

The invention discloses a target recognition and tracking system based on multi-source video integration and belongs to the technical field of image processing and automatic control. A first video source acquisition module and a second video source acquisition module carry out video acquisition on the same scene respectively by using a digital thermal-imaging camera and a digital visible-light camera and transmit digital infrared video signals and digital visible-light video signals to a target recognition and tracking module; the target recognition and tracking module carries out integration on infrared video frames and visible-light video frames by using a multi-resolution-based multi-source video integration method and then carries out target recognition and target movement trajectory tracking on integrated video frames; a signal display module is used for displaying the movement trajectory of a target in real time. The target recognition and tracking system based on the multi-source video integration has the advantages that the system is simple in design, so that the realization is convenient; the size is smaller, so that the carrying is convenient; a DSP (Digital Signal Processor) and an ARM (Asynchronous Response Mode) serve as a processing chip, so that the operating speed is high, and the requirements on real time can be reached.

Description

technical field [0001] The invention belongs to the technical field of image processing and automatic control, and relates to image registration, image fusion, target recognition and target tracking technologies, in particular, a target recognition and tracking system based on multi-source video fusion. Background technique [0002] Due to the sensor imaging mechanism and its own characteristics, a single image sensor generally cannot extract enough information from the scene. Multi-source image fusion studies how to combine image data acquired by different types of sensors with certain algorithms to organically combine their advantages or complementary information to generate new images. Multi-source video fusion is developed on the basis of image fusion. It combines the video frames captured by different sensors, uses image fusion at the same time and background for continuous fusion, and finally combines the fused image frames Save it as a video. [0003] The research o...

AI Technical Summary

Problems solved by technology

[0006] At present, the more portable target recognition and tracking devices we commonly use are based on a single camera, and the target information obtained is not accurate enough.

However, the target recognition and tracking technology based on multi-source video fusion is almost still in the laboratory environment based on PC, which is obviously not convenient enough.

Then, providing a target recognition and tracking system based on multi-source video fusion can not only solve the misrecognition phenomenon caused by insufficient information obtained by a single camera, but also solve the disadvantage that it is not convenient for outdoor use in a PC-based environment.

Images