Television infrared composite image target tracking method and system based on FPGA (Field Programmable Gate Array)

By implementing the TV infrared multi-mode feature enhancement converter tracking model on FPGA, the problems of low target tracking accuracy and poor robustness in complex environments are solved, and the effects of high accuracy and real-time tracking are achieved.

CN119693412APending Publication Date: 2025-03-25HEBEI HANGUANG HEAVY IND
0 Cites 1 Cited by

Patent Information

Application Number
CN202411547737.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-01
Publication Date
2025-03-25

AI Technical Summary

Technical Problem

The prior art has low target tracking accuracy, poor robustness and slow operation speed in complex and diverse environments (such as lighting changes, night environments and occlusions), making it difficult to achieve real-time tracking.

Method used

Using the FPGA-based TV infrared composite image target tracking method, the TV and infrared dual-channel video streaming images are collected in real time, and the TV infrared multi-mode feature enhancement converter tracking model is realized using HLS high-level comprehensive integration to complete the feature extraction, fusion and prediction of multi-mode images, and the target tracking results are obtained.

Benefits of technology

By leveraging the complementary advantages of TV and infrared images, the joint representation ability of multimodal data is improved, the tracking accuracy and robustness are enhanced, and the algorithm is accelerated on FPGA, real-time robust tracking in complex environments is achieved.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention discloses a television infrared composite image target tracking method and system based on an FPGA (Field Programmable Gate Array). The method comprises the following steps: acquiring television and infrared double-channel video stream images, cross-clock domain synchronous frame frequency and size in real time; hLS high-level synthesis is carried out, a television infrared multimode feature enhancement converter tracking model is realized, feature extraction, fusion and prediction of multimode images are completed, and a target tracking result is obtained; superposing a tracking frame, and outputting a video stream in real time; according to the invention, the problems of low tracking precision, poor robustness, slow operation speed and difficulty in real-time tracking of an edge device end target tracking algorithm in complex and diverse environments such as illumination variation, night environment and target shielding in the prior art can be solved.
Need to check novelty before this filing date? Find Prior Art