Object Tracking via Particle Filter and CNN Similarity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing object tracking algorithms face challenges in achieving high accuracy and speed performance, particularly in video frame tracking, as they often rely on template matching and lack efficient methods for predicting object motion and distinguishing between objects and backgrounds.

Innovation Solution

The proposed method employs a particle filter in conjunction with a pre-trained convolutional neural network (CNN) model to generate and track candidate particles, predicting their motion through drift and diffuse processes, and calculates similarities using a pre-trained CNN to determine optimal particle positions, thereby enhancing tracking accuracy and speed.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If template matching is used for object tracking, then the tracking process is simple, but the tracking accuracy and speed performance deteriorate

Engineering Contradiction:
Improvetracking process complexityVSAvoidtracking accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent introduces a pre-trained CNN model as an intermediary between template matching and final tracking decisions. The CNN model processes candidate particles and provides similarity scores that guide the selection of optimal tracking positions, thereby improving accuracy while maintaining computational efficiency through the particle filter framework

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If template matching is used for object tracking, then the algorithm is computationally efficient, but the speed performance deteriorates

Engineering Contradiction:
Improvecomputational efficiencyVSAvoidtracking speed
Core Design Contradiction:
ProductivityVSSpeed

Solution Approach 1:

The patent performs preliminary action by pre-training the CNN model offline using a video dataset before actual tracking. This pre-training phase separates feature learning from real-time tracking, allowing the tracking process to use the pre-learned features for rapid inference, thus improving tracking speed without sacrificing accuracy

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If a pre-trained CNN model is used for tracking, then tracking accuracy improves, but computational complexity increases

Engineering Contradiction:
Improvetracking accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies partial action by using the CNN model only for evaluating candidate particles generated by the particle filter, rather than processing the entire video frame. This selective application of the complex CNN model to only relevant regions maintains accuracy while reducing overall computational complexity

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11176680B2Method of tracking object and apparatuses performing the same
Publication Date: 2021.11.16 KONKUK UNIV IND COOP CORP
  • US11176680B2 patent drawing
  • US11176680B2 patent drawing
  • US11176680B2 patent drawing

AI summary

Disclosed is a method of tracking an object and apparatuses performing the same, the method including generating a plurality of candidate particles corresponding to an object in a video frame to track the object, and tracking the object by generating optimal particles corresponding to a position of the object in the video frame based on similarities of the plurality of candidate particles with respect to the object.