Lost Blob Tracker Recovery in Video Analytics

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Video analytics systems face challenges in maintaining accurate object tracking when objects become occluded or leave the scene, leading to lost trackers and misalignment upon re-detection, which results in increased false positives and diminished tracking accuracy.

Innovation Solution

The system implements a method to manage lost blob trackers by determining a recovery duration for trackers that transition from active to lost states, allowing re-association when the lost duration is less than the adaptive tracker recovery duration, thereby maintaining tracker continuity and accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a blob tracker is removed when an object is temporarily occluded or leaves the scene, then false positives are reduced, but tracking continuity is lost and new objects are incorrectly created

Engineering Contradiction:
Improvetracking accuracyVSAvoidtracker continuity
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The system establishes a lost tracker buffer zone before complete tracker loss occurs. When a blob is not detected, the tracker transitions to a lost state rather than being immediately removed, providing a cushioning period during which the tracker can be recovered if the object reappears within the buffer duration

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Solution Approach 2:

The system performs preliminary classification of lost trackers by determining a recovery duration threshold before deciding whether to remove the tracker. This preliminary action allows the system to prepare recovery strategies in advance, distinguishing between temporary occlusions and permanent tracker losses

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If a lost tracker is maintained for a long recovery duration, then tracking continuity is preserved, but system resources are consumed and false positives increase

Engineering Contradiction:
Improvetracker continuityVSAvoidsystem efficiency
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The system dynamically adjusts the recovery duration threshold based on tracker characteristics and scene context rather than using a fixed duration. This dynamic adaptation allows the system to optimize resource consumption while maintaining tracking continuity for persistent objects

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the recovery duration parameter adaptively, modifying it based on the specific tracker's history, object persistence patterns, and current scene conditions. This parameter adjustment enables efficient resource management while preserving tracker continuity when appropriate

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If object detection is performed for every video frame, then detection accuracy is improved, but computational complexity increases and processing speed decreases

Engineering Contradiction:
Improvedetection accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Instead of performing full object detection for every video frame, the system implements periodic detection only for lost trackers that fall within the recovery duration window. This periodic action reduces computational complexity while maintaining detection accuracy for critical cases

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system performs detection selectively on a subset of trackers (those in lost state within recovery duration) rather than all trackers in all frames. This partial action approach reduces overall computational load while focusing resources where they are most needed for maintaining tracking accuracy

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10360456B2Methods and systems of maintaining lost object trackers in video analytics
Publication Date: 2019.07.23 QUALCOMM INC
  • US10360456B2 patent drawing
  • US10360456B2 patent drawing
  • US10360456B2 patent drawing

AI summary

Techniques and systems are provided for maintaining lost blob trackers for one or more video frames. In some examples, one or more blob trackers maintained for a sequence of video frames are identified. The one or more blob trackers are associated with one or more blobs of the sequence of video frames. A transition of a blob tracker from a first type of tracker to a lost tracker is detected at a first video frame. For example, the blob tracker can be transitioned from the first type of tracker to the lost tracker when a blob for which the blob tracker was associated with in a previous frame is not detected in the first video frame. A recovery duration is determined for the lost tracker at the first video frame. For one or more subsequent video frames obtained after the first video frame, the lost tracker is removed from the one or more blob trackers maintained for the sequence of video frames when a lost duration for the lost tracker is greater than the recovery duration. The blob tracker can be transitioned back to the first type of tracker if the lost tracker is associated with a blob in a subsequent video frame prior to expiration of the recovery duration. Trackers and associated blobs are output as identified blob tracker-blob pairs when the trackers are converted from new trackers to trackers of the first type.