Spatio-Temporal Graphical Model for Object Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current computer vision systems face challenges in accurately detecting and tracking objects across images and video frames due to variations in feature representation and detection methods, particularly in handling complex objects and occlusions.

Innovation Solution

A spatio-temporal graphical model is employed for object detection, using a two-layer graphical model with nodes representing the object and its components, incorporating temporal and spatial constraints, and leveraging Adaptive Boosting detectors and non-parametric belief propagation for inference and tracking.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a spatio-temporal graphical model with multiple components is used for object detection, then detection reliability under occlusion and varying conditions is improved, but computational complexity and processing time increase

Engineering Contradiction:
Improvedetection reliabilityVSAvoidcomputational complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The object is segmented into multiple detectable components (e.g., head, torso, limbs for pedestrians; wheels, body, windows for vehicles). Each component has its own detector that operates independently, allowing the system to detect objects even when parts are occluded. The graphical model integrates these component detections to infer the presence and state of the complete object.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A graphical model serves as an intermediary layer between component-level detections and object-level recognition. This model encodes spatial and temporal constraints that mediate how component detections are combined to form object detections, enabling robust inference under occlusion while managing computational complexity through structured probabilistic reasoning.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If component-based detection with graphical models is employed, then detection accuracy under occlusion is improved, but processing speed decreases

Engineering Contradiction:
Improvedetection accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

Spatial constraints between components are pre-computed and encoded in the graphical model before detection. This allows the system to quickly evaluate whether detected components are consistent with valid object configurations without performing complex computations during real-time detection, thereby improving processing speed while maintaining accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts the temporal window size and constraint tightening based on detection confidence and object motion characteristics. During high-motion scenarios or low-confidence detections, the system relaxes constraints to maintain speed; during stable scenarios, it tightens constraints to improve accuracy, achieving adaptive performance optimization.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS7436980B2Graphical object models for detection and tracking
Publication Date: 2008.10.14 VL COLLECTIVE IP LLC
  • US7436980B2 patent drawing
  • US7436980B2 patent drawing
  • US7436980B2 patent drawing

AI summary

A computer implemented method for object detection includes providing a spatio-temporal model for an object to be detected, providing a video including a plurality of images including the object, and measuring the object as a collection of components in each image. The method further includes determining a probability that the object is in each image, and detecting the object in any image upon comparing the probabilities for each image to a threshold for detecting the object.