Rival Compensation for Video Tracking in Crowded Scenes

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video tracking systems, such as the mean-shift tracker, struggle with accurately tracking objects when there are occlusions or when objects with similar appearances are nearby, leading to errors in position estimation and incorrect identification of tracks.

Innovation Solution

The method involves creating compensated appearance models by attenuating common features among overlapping objects' appearance models, allowing for improved tracking by comparing and adjusting the position of objects based on these models, particularly using rival-compensated histograms to differentiate between similar objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional appearance models are used for tracking overlapping objects, then the tracking process is simple and computationally efficient, but the tracking accuracy deteriorates when objects have similar appearances or are partially occluded

Engineering Contradiction:
Improvetracking accuracyVSAvoidappearance model complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The appearance model is segmented into multiple components: the original appearance model and rival appearance models for each overlapping object. This segmentation allows the system to separately model and compensate for the visual interference of each overlapping object, thereby improving tracking accuracy in crowded scenes with similar appearances

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Rival appearance models are introduced as intermediary representations that capture the visual characteristics of overlapping objects. These rival models act as mediators to compensate for the interference caused by overlapping objects, enabling the tracker to distinguish between the target object and its visual counterparts

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If appearance models include all visual features, then the model captures complete object information, but it becomes difficult to distinguish between visually similar overlapping objects

Engineering Contradiction:
Improveobject differentiation accuracyVSAvoidappearance feature information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The method extracts and separates the visual features of the target object from those of overlapping objects by creating rival appearance models. These rival models specifically capture the interfering visual features, allowing the system to isolate and compensate for the interference without losing important appearance information of the target object

Inventive Principle:
Principle #2Taking out (Extraction)

3Reliability

If the tracker uses standard mean-shift algorithm, then computational efficiency is maintained, but tracking reliability decreases in crowded scenes with occlusions

Engineering Contradiction:
Improvetracking robustnessVSAvoidtracking algorithm complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by creating rival appearance models before the actual tracking process. This preliminary modeling of overlapping objects' appearances allows the tracker to anticipate and compensate for potential interference, improving reliability in crowded scenes without significantly increasing real-time computational burden

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The tracking system incorporates feedback through the rival compensation mechanism, where the rival appearance models provide continuous correction information about overlapping objects' visual interference. This feedback loop enables the tracker to adapt and maintain reliability even when objects are partially occluded or have similar appearances

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9633265B2Method for improving tracking in crowded situations using rival compensation
Publication Date: 2017.04.25 CANON KK
  • US9633265B2 patent drawing
  • US9633265B2 patent drawing
  • US9633265B2 patent drawing

AI summary

A method for tracking objects across a number of image frames includes tracking objects in the frames based on appearance models of each foreground region corresponding to each of the objects and determining if a plurality of the tracked objects overlap. Where a plurality of the tracked objects overlap, the method creates compensated appearance models for each of the plurality of overlapping objects by attenuating common appearance features among the corresponding appearance models; and tracks the plurality of overlapping objects based on the created compensated appearance models.