Zero-Shot Cross-Domain Video Anomaly Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current cross-domain video anomaly detection methods require access to both source and target domain normal data, which is not feasible in scenarios where data collection is restricted due to security and privacy concerns.

Innovation Solution

A zero-shot cross-domain video anomaly detection system that collects videos from a source domain and uses a future frame prediction module and an object-aware anomaly synthesis module to generate pseudo abnormal frames, allowing for training of neural networks without target domain data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If cross-domain video anomaly detection is performed using existing methods, then anomaly detection capability is improved, but access to target domain normal data is required which is not feasible due to security and privacy concerns

Engineering Contradiction:
Improveanomaly detection capabilityVSAvoiddata access requirement
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent uses a generator network to create synthetic pseudo-normal frames that copy the statistical and structural properties of target domain normal data without requiring actual access to target domain videos. These synthesized frames serve as proxies for real normal data, enabling model training in a zero-shot cross-domain setting while respecting security and privacy constraints.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces an intermediary synthesis module that generates pseudo-normal frames acting as a mediator between the source domain training data and the target domain anomaly detection task. This intermediary component bridges the domain gap without requiring direct access to target domain normal data, resolving the contradiction between detection reliability and data access feasibility.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If zero-shot cross-domain video anomaly detection is implemented without target domain data, then data access requirements are reduced, but the complexity of generating pseudo-normal frames and training models increases

Engineering Contradiction:
Improvedata access requirementVSAvoidmodel training complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent segments the anomaly detection task into distinct functional modules: a generator network for synthesizing pseudo-normal frames, a discriminator network for distinguishing real from synthetic frames, and an anomaly detection model for identifying abnormal events. This segmentation allows each component to be trained independently with specific objectives, managing overall system complexity while achieving zero-shot cross-domain detection.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary action by pre-training the generator and discriminator networks on source domain data before deploying the anomaly detection model to the target domain. This preliminary training phase creates a robust feature extraction capability and synthetic data generation ability that simplifies the subsequent zero-shot detection task, reducing the operational complexity despite the sophisticated architecture.

Inventive Principle:
Principle #10Preliminary action

3Quantity of substance

If pseudo abnormal frames are generated using foreground objects from source domain videos, then the system can train without target domain abnormal data, but the quality and realism of synthesized anomalies may be compromised

Engineering Contradiction:
Improvetraining data availabilityVSAvoidanomaly synthesis quality
Core Design Contradiction:
Quantity of substanceVSManufacturing precision

Solution Approach 1:

The patent applies local quality by extracting foreground objects from source domain videos and using them to corrupt specific local regions of pseudo-normal frames. This localized corruption approach ensures that anomalies appear in semantically meaningful locations with realistic appearances, improving synthesis quality while maintaining the ability to train without target domain abnormal data.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent creates composite training samples by combining pseudo-normal frames (synthesized from source domain statistics) with foreground objects (extracted from source domain videos) to generate pseudo-abnormal frames. This composite approach leverages the strengths of both synthetic and real data components, achieving adequate anomaly synthesis quality for effective training in zero-shot cross-domain settings.

Inventive Principle:
Principle #40Composite materials

Data Source

PatentUS12315242B2Method and system for zero-shot cross domain video anomaly detection
Publication Date: 2025.05.27 MITSUBISHI ELECTRIC RESEARCH LABORATORIES INC
  • US12315242B2 patent drawing
  • US12315242B2 patent drawing
  • US12315242B2 patent drawing

AI summary

Embodiments of the present invention disclose a method and system for performing video anomaly detection by training neural networks. The method includes collecting a video of one or more digital images from a source domain. The method includes obtaining a set of images of foreground objects present in the video. In addition, the method includes training of a first neural network to predict frames for the one or more digital images in the video. The first neural network is trained using a future frame prediction module that predicts frames for the one or more digital image. The method includes training of a second neural network to classify the predicted frame as normal and to classify the synthesized pseudo anomaly frame as abnormal. The method includes performing video anomaly detection based on training of the first neural network and the second neural network.