FPGA Target Tracking Hardware for KCF Algorithm

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing Kernelized Correlation Filter (KCF) algorithms for target tracking are inefficient in real-time multi-target tracking due to high power consumption and limited parallelism on general-purpose processors, making them unsuitable for high-resolution video processing.

Innovation Solution

A hardware implementation system utilizing a Field Programmable Logic Array (FPGA) or Application-Specific Integrated Circuit (ASIC) for parallel processing, which includes an intercepting and scaling module, feature extracting module, feature managing module, and KCF calculating module to normalize and track multiple targets in real-time, leveraging discrete Fourier transforms and parallel computing resources.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If KCF algorithm is implemented on general-purpose processor (CPU/GPU/ARM), then software flexibility is maintained, but parallelism is limited and power consumption is high

Engineering Contradiction:
Improvesoftware flexibilityVSAvoidpower consumption
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent replaces the software-based implementation on general-purpose processors with a hardware-based implementation using FPGA. This substitution transforms the computational system from software execution to hardware circuit operation, enabling parallel processing while reducing power consumption. The FPGA-based architecture implements the KCF algorithm through dedicated hardware circuits that can simultaneously perform multiple computational operations.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent divides the KCF algorithm implementation into multiple independent computational modules that can operate in parallel on the FPGA. By segmenting the algorithm into discrete functional units (such as separate correlation filter computation units, feature extraction units, and response calculation units), the system achieves higher parallelism and reduces the computational burden on any single processing element, thereby lowering overall power consumption.

Inventive Principle:
Principle #1Segmentation

2Speed

If high-performance CPU or GPU is used, then calculation speed is improved, but main frequency increases and power consumption increases

Engineering Contradiction:
Improvecalculation speedVSAvoidpower consumption
Core Design Contradiction:
SpeedVSUse of energy by stationary object

Solution Approach 1:

The patent replaces high-performance general-purpose processors (CPU/GPU) with a specialized hardware implementation on FPGA. This substitution eliminates the need for high main frequency processors by using dedicated parallel hardware circuits that perform the same computational tasks simultaneously, achieving high calculation speed without the excessive power consumption associated with high-frequency processors.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Device complexity

If serial computing is performed on general-purpose processor, then device complexity is reduced, but real-time performance is insufficient for multi-target tracking

Engineering Contradiction:
Improvecomputing architecture simplicityVSAvoidreal-time processing capability
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent segments the target tracking system into multiple parallel processing channels on the FPGA, where each channel can independently process different targets or different stages of the tracking algorithm. This segmentation enables simultaneous processing of multiple targets, achieving real-time performance while maintaining manageable system complexity through modular architecture design.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from serial computing (one-dimensional time progression) to parallel computing (adding a spatial dimension of simultaneous operations). By implementing multiple computational paths that operate concurrently on the FPGA, the system processes multiple targets or multiple algorithmic stages simultaneously, dramatically improving real-time processing capability without proportionally increasing device complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10810746B2Target tracking hardware implementation system and method
Publication Date: 2020.10.20 XILINX TECH BEIJING LTD
  • US10810746B2 patent drawing
  • US10810746B2 patent drawing
  • US10810746B2 patent drawing

AI summary

A target tracking hardware implementation system and method are provided. The target tracking hardware implementation system (200) includes: an intercepting and scaling module (210) configured to intercept a target image and to-be-checked images of a plurality of sizes from a video in an external storage module (300), and normalize the images to a specified size by scaling; a feature extracting module (220) configured to extract features of the normalized images; a feature managing module (230) configured to access and update a matching template based on the extracted image features; a Kernelized Correlation Filter (KCF) calculating module (240) configured to calculate the KCF response of each of the to-be-checked images based on the extracted image features and the updated matching template, and select the to-be-checked image with the largest KCF response as the tracked target. The system and method integrate the advantages of the existing KCF algorithm and are implemented on a parallel hardware platform, have the advantages of being small in size, low in power consumption and high in real-timeliness.