Dynamic Background Compensation for Video Object Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video tracking systems, such as those using the mean-shift tracker, struggle to accurately track objects when the background has a similar appearance to the object, leading to tracking failures and loss of object detection due to inclusion of background pixels and reduced bounding box size.

Innovation Solution

A method that creates a dynamic background-compensated histogram by attenuating features based on their representation in the predicted background region, using a combination of initial and updated appearance models to correct the location and size of the predicted region, and employing the mean-shift procedure to refine the track location.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If mean-shift tracking is used to follow objects with similar appearance to background, then tracking continuity is improved, but measurement precision deteriorates due to inclusion of background pixels

Engineering Contradiction:
Improvetracking continuityVSAvoidlocation accuracy
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent applies local quality by creating a dynamic background model specific to each tracked object's local region. Instead of using a global background model, the system adapts the background representation to each object's specific surroundings, allowing precise differentiation between object and background even when they have similar appearances. This local adaptation maintains tracking continuity while preserving location accuracy.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent changes parameters by dynamically updating the background histogram based on the object's movement and appearance variations. The system adjusts the background model parameters (histogram bins, weighting factors) in real-time as the object moves through different regions, enabling the tracker to maintain precision despite appearance changes and similar backgrounds.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If background regions are excluded from histogram calculation to improve precision, then location accuracy is improved, but reliability deteriorates when objects move to similar background areas

Engineering Contradiction:
Improvelocation accuracyVSAvoidtracking continuity
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent applies dynamics by making the background model adaptive and time-varying. Instead of statically excluding background regions, the system dynamically updates the background histogram based on the object's current position and historical movement patterns. This dynamic adaptation allows the tracker to maintain both precision and reliability as objects move through different background conditions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements feedback by continuously comparing the object's appearance against the dynamic background model and using this information to adjust tracking parameters. The system provides feedback loops where tracking results inform background model updates, which in turn improve subsequent tracking precision without sacrificing reliability in challenging scenarios.

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If Exemplar View Histogram is updated frequently to adapt to appearance changes, then adaptability is improved, but device complexity increases due to multiple model maintenance

Engineering Contradiction:
Improveappearance change adaptationVSAvoidmodel maintenance complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges the Exemplar View Histogram and dynamic background model into a unified tracking framework. By combining these two histogram representations and their update mechanisms, the system achieves appearance adaptation without requiring separate complex maintenance procedures for multiple independent models, thus reducing overall device complexity while maintaining adaptability.

Inventive Principle:
Principle #5Merging (Combining)

4Reliability

If background compensation is applied dynamically to handle similar appearances, then reliability is improved, but device complexity increases due to additional processing steps

Engineering Contradiction:
Improvetracking robustnessVSAvoidprocessing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies self-service by enabling the tracking system to automatically adapt its own background model without external intervention. The dynamic background compensation mechanism serves itself by using tracking results to inform background updates, which in turn improve tracking reliability. This self-adapting mechanism reduces the need for complex external processing and manual model management.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS9317772B2Method for improving tracking using dynamic background compensation with centroid compensation
Publication Date: 2016.04.19 CANON KK
  • US9317772B2 patent drawing
  • US9317772B2 patent drawing
  • US9317772B2 patent drawing

AI summary

A method for tracking an object across a number of image frames comprises identifying a region containing the object in a first image frame to be stored as an exemplar view of the object. An appearance model (modified Exemplar View histogram is created based on the region in the first image frame and a background region in a second image frame, and the method determines at least one of a location and size of a predicted region for tracking the object in the second image frame using the appearance model. The method corrects at least one of the determined location and size of the predicted region in the second image frame in accordance with at least one of the location and size of the region in the first image frame corresponding to the exemplar view of the object.