Dynamic roi target closed loop tracking method, system and related devices

By employing a heterogeneous hardware architecture combining the STM32N6 main control module and the FPGA coprocessor module, along with a Kalman filter algorithm, real-time stable target tracking of ultra-high-definition video on low-power miniaturized edge devices was achieved. This resolved the contradiction between computing power and real-time performance, as well as the target stability issue in existing technologies, thereby improving tracking accuracy and stability.

CN122415982APending Publication Date: 2026-07-17BAO NA SHENG (SHENZHEN) TECH CO LTD

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
BAO NA SHENG (SHENZHEN) TECH CO LTD
Filing Date
2026-04-21
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing technologies struggle to achieve real-time, stable target tracking of ultra-high-definition video on low-power, miniaturized edge devices. This is due to issues such as the conflict between computing power and real-time performance, hardware architecture bottlenecks, insufficient target centering stability, and poor compatibility with power consumption and miniaturization.

Method used

A heterogeneous hardware architecture combining an STM32N6 main control module and an FPGA coprocessor module is adopted. The FPGA coprocessor module performs image cropping and scaling, while the STM32N6 main control module performs AI target inference and trajectory prediction, constructing a dynamic ROI closed-loop tracking link. Combined with the Kalman filter algorithm, delay compensation and ROI adaptive adjustment are performed to achieve efficient target tracking.

Benefits of technology

It achieves real-time stable target tracking of ultra-high-definition video under low power consumption, solves the computing power and bandwidth bottleneck of edge devices, ensures dynamic tracking of the target in the ROI center, and improves tracking stability in high-speed movement and near-far zoom scenarios.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122415982A_ABST
    Figure CN122415982A_ABST
Patent Text Reader

Abstract

本发明提供了一种动态ROI目标闭环跟踪方法、系统及相关设备,方法包括通过FPGA协处理模块根据当前帧ROI参数从图像采集模块获取的视频帧中硬件裁剪出ROI区域图像,并硬件缩放为预设固定分辨率的预处理图像;将预处理图像传输至STM32N6主控模块,通过其内置的硬件NPU进行AI目标推理,获得目标在预处理图像内的中心相对坐标与尺寸信息;以及基于中心相对坐标与尺寸信息计算出下一帧ROI参数,下发至FPGA协处理模块用于下一视频帧的处理。本发明通过基于FPGA协处理模块和STM32N6主控模块的异构算力协同与分工,将视频预处理与AI推理有效分离,解决了边缘设备处理高清视频的算力与带宽瓶颈,实现了低功耗、低延迟的实时目标跟踪。
Need to check novelty before this filing date? Find Prior Art