Finite State Machine for Static Object Tracking in Video Surveillance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Automated video surveillance systems face challenges in accurately distinguishing and tracking object movements, especially in complex environments with clutter, poor lighting, and occlusions, leading to high false alarms and inefficient detection of abandoned objects.

Innovation Solution

The implementation of region-level adaptive background modeling using a finite state machine to classify and track temporally static objects, which involves classifying detected bounding boxes as background, moving foreground, or static objects based on pixel staticness ratios, and updating the background model dynamically to reduce contamination and improve detection accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If automated video analysis is used to detect object movements and activities, then productivity is improved, but reliability deteriorates due to clutter, poor lighting, and visual distractions

Engineering Contradiction:
Improvevideo analysis efficiencyVSAvoidobject tracking accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent divides the video frame into multiple regions or zones and processes each region independently through background modeling and foreground detection. This segmentation allows the system to handle complex scenes with clutter by focusing on specific areas, improving both processing efficiency and detection reliability in each region.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic background modeling that adapts to changing scene conditions over time. The background model is continuously updated based on observed pixel patterns, allowing the system to handle variations in lighting, clutter, and scene composition dynamically, thereby maintaining high reliability despite environmental changes.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If background modeling is used to distinguish foreground objects, then object detection precision is improved, but false alarms increase due to temporarily static objects being misclassified

Engineering Contradiction:
Improveobject detection precisionVSAvoidfalse alarm rate
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent introduces temporal dynamics by tracking objects over multiple frames and comparing their movement patterns against the background model. Objects that remain static for extended periods are flagged as potential false alarms, while dynamically updating the background model prevents misclassification of temporarily static objects. This temporal dimension resolves the contradiction between detection precision and false alarm rate.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements feedback mechanisms where detected foreground objects and their movement patterns are fed back into the background modeling process. This feedback allows the system to learn from detected objects and adjust the background model accordingly, reducing false alarms by distinguishing between truly static background elements and temporarily static foreground objects through iterative refinement.

Inventive Principle:
Principle #23Feedback

3Reliability

If human visual surveillance is used to monitor video data, then reliability is improved through human judgment, but productivity deteriorates due to tedium and high costs

Engineering Contradiction:
Improvesurveillance reliabilityVSAvoidsurveillance efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent implements self-service automation where the video analysis system performs its own background modeling, foreground detection, and object tracking without requiring human intervention. The system automatically adapts to scene changes, manages its own parameters, and generates alerts autonomously, thereby eliminating the tedium and high costs of human surveillance while maintaining reliability through sophisticated automated algorithms.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS8744123B2Modeling of temporarily static objects in surveillance video data
Publication Date: 2014.06.03 KYNDRYL INC
  • US8744123B2 patent drawing
  • US8744123B2 patent drawing
  • US8744123B2 patent drawing

AI summary

A foreground object blob having a bounding box detected in frame image data is classified by a finite state machine as a background, moving foreground, or temporally static object, namely as the temporally static object when the detected bounding box is distinguished from a background model of a scene image of the video data input and remains static in the scene image for a threshold period. The bounding box is tracked through matching masks in subsequent frame data of the video data input, and the object sub-classified within a visible sub-state, an occluded sub-state, or another sub-state that is not visible and not occluded as a function of a static value ratio. The ratio is a number of pixels determined to be static by tracking in a foreground region of the background model corresponding to the tracked object bounding box over a total number of pixels of the foreground region.