Abnormality Analysis Apparatus Using Action Order and Timing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for analyzing abnormalities in video data focus solely on the order of actions, neglecting the temporal aspects, which limits their accuracy in detecting deviations in action sequences.

Innovation Solution

An abnormality analysis apparatus and method that detects a cycle of predetermined actions from a video frame sequence, determines action times for each action, and analyzes abnormalities based on both the order and timing of actions, enhancing the accuracy of abnormality detection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If only the order of actions is analyzed for abnormality detection, then the analysis method is simple, but the detection accuracy is insufficient

Engineering Contradiction:
Improveabnormality detection accuracyVSAvoidanalysis method complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the action analysis into two independent dimensions: action order analysis and action time analysis. The abnormality analysis unit divides the comprehensive abnormality detection into multiple sub-analyses, evaluating order deviations and time deviations separately, then integrates them for final abnormality determination. This segmentation allows each analysis component to remain relatively simple while achieving high overall detection accuracy through multi-dimensional evaluation.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If action time is incorporated into abnormality analysis along with action order, then the detection accuracy improves, but the computational complexity increases

Engineering Contradiction:
Improveabnormality detection accuracyVSAvoidcomputational resource consumption
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent implements partial action by selectively analyzing only the necessary temporal and sequential aspects of actions rather than processing all possible video features. The abnormality analysis unit focuses specifically on order relationships and time intervals, ignoring redundant visual details. This partial analysis approach achieves sufficient detection accuracy while minimizing computational resource consumption and information processing overhead.

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If comprehensive analysis of both order and timing is performed, then the identification of abnormal behaviors improves, but the processing time increases

Engineering Contradiction:
Improveabnormal behavior identification reliabilityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent performs preliminary extraction of action order and action time information during video processing, before the actual abnormality analysis. The video data is pre-processed to identify and record the sequence and timing of actions, storing this structured information for efficient later analysis. This preliminary action reduces the computational burden during the abnormality detection phase, maintaining high reliability while minimizing processing time.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20240404281A1Abnormality analysis apparatus, abnormality analysis method, and non-transitory computer-readable medium
Publication Date: 2024.12.05 NEC CORP
  • US20240404281A1 patent drawing
  • US20240404281A1 patent drawing
  • US20240404281A1 patent drawing

AI summary

An abnormality analysis apparatus detects, from a first video frame sequence, a second video frame sequence indicating a cycle being a set of a predetermined plurality of actions. The abnormality analysis apparatus determines an action time of each action indicated by the second video frame sequence. The abnormality analysis apparatus analyzes an abnormality of an action indicated by the second video frame sequence, based on order of actions indicated by the second video frame sequence and an action time of each action.