Video Anomaly Detection Using Probabilistic Graphical Models

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video anomaly detection (VAD) systems in surveillance are complex, opaque, and require significant training data, leading to performance variance across datasets and difficulties in retraining, with Deep Learning solutions not yet achieving high accuracy for VAD tasks.

Innovation Solution

A computer-implemented method using a Probabilistic Graphical Model (PGM) with a Discrete Bayesian Network (DBN) for detecting and tracking objects across video frames, modeling spatial and temporal dimensions, and employing multi-object tracking to identify anomalies through conditional probability distributions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If Deep Learning based VAD systems are used, then automation extent is improved, but device complexity increases and reliability decreases due to performance variance across datasets

Engineering Contradiction:
Improveautomation of anomaly detectionVSAvoiddetection accuracy consistency
Core Design Contradiction:
Extent of automationVSReliability

Solution Approach 1:

The patent replaces complex Deep Learning neural networks with a Probabilistic Graphical Model (PGM) framework that uses Bayesian networks and Markov random fields. This substitution maintains automation while improving reliability through mathematically rigorous probability theory that provides consistent performance across different surveillance datasets without the variability inherent in DL models.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the fundamental parameters of the VAD system by using probabilistic graphical models with explicit probability distributions and graphical representations of dependencies. This parameter change enables the system to handle uncertainty formally through probability theory, achieving more reliable and consistent anomaly detection across varying surveillance conditions and datasets.

Inventive Principle:
Principle #35Parameter changes

2Extent of automation

If existing VAD systems are used, then automation is achieved, but device complexity increases and ease of operation decreases due to opacity in reaching conclusions

Engineering Contradiction:
Improveautomated anomaly detectionVSAvoidinterpretability of detection process
Core Design Contradiction:
Extent of automationVSEase of operation

Solution Approach 1:

The patent introduces Probabilistic Graphical Models as an intermediary layer between raw video data and anomaly detection conclusions. The PGM framework provides explicit probabilistic representations and graphical models that serve as intermediaries, making the detection process transparent and interpretable while maintaining full automation. Users can understand why certain anomalies are detected through the probabilistic reasoning and graphical model structures.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If existing VAD systems are used, then anomaly detection is performed, but manufacturing precision decreases due to difficulty in retraining

Engineering Contradiction:
Improveanomaly detection capabilityVSAvoidretrainability of system
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent implements a dynamic and flexible PGM framework that can be easily adapted and retrained for different surveillance scenarios. The probabilistic graphical model structure allows for dynamic adjustment of parameters, conditional probability distributions, and graphical dependencies without requiring complete system redesign. This dynamic capability enables precise retraining for new anomaly types or surveillance environments while maintaining the core detection functionality.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20240303986A1Video anomaly detection
Publication Date: 2024.09.12 MILESTONE SYSTEMS
  • US20240303986A1 patent drawing
  • US20240303986A1 patent drawing
  • US20240303986A1 patent drawing

AI summary

A computer implemented method of Video Anomaly Detection. VAD, the method comprising: detecting and tracking at least one object of interest across consecutive frames of video surveillance data; performing VAD using a Probabilistic Graphical Model, PGM, based on the said at least one object that has been detected and tracked.