Monitoring Apparatus for Abnormal Situation Severity Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing abnormality detection systems using sound analysis can effectively detect the occurrence of abnormal situations but struggle to determine the severity of the situation, making it difficult to assess whether a security response is urgent or not.

Innovation Solution

A monitoring apparatus and system that combines sound detection with video analysis to estimate the severity of an abnormal situation by acquiring the occurrence position, analyzing the state of the crowd around the event, and estimating the severity based on video data, including line-of-sight and facial expression recognition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If sound analysis is used for abnormality detection, then the detection of unexpected abnormal situations is effective, but the severity of the situation cannot be grasped

Engineering Contradiction:
Improveabnormality detection effectivenessVSAvoidseverity information
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent combines sound analysis and video analysis into a unified monitoring system. The sound analysis unit detects abnormal situations using acoustic signals, while the video analysis unit simultaneously captures visual information. By merging these two analysis streams, the system achieves both the reliability of unexpected abnormality detection and the ability to assess severity through visual observation of the scene and crowd reactions.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The monitoring system is designed with multi-functionality to handle both detection and severity assessment. The same monitoring apparatus performs multiple functions: detecting abnormal situations via sound, analyzing video data to determine severity, estimating crowd state, and providing location information. This universal approach eliminates the need for separate systems while capturing both detection effectiveness and severity information.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Loss of information

If video analysis is used for abnormality detection, then the severity of the situation can be grasped, but the detection of unexpected abnormal situations is less effective

Engineering Contradiction:
Improveseverity informationVSAvoidabnormality detection effectiveness
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The patent merges sound analysis and video analysis into a unified monitoring system. The sound analysis unit detects abnormal situations using acoustic signals, while the video analysis unit simultaneously captures visual information. By merging these two analysis streams, the system achieves both the reliability of unexpected abnormality detection and the ability to assess severity through visual observation of the scene and crowd reactions.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system performs preliminary sound analysis to detect abnormal situations before conducting detailed video analysis for severity assessment. This preliminary action allows the system to trigger video analysis only when abnormal sounds are detected, making the system responsive to unexpected events while maintaining the capability to assess severity through subsequent visual analysis.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If sound analysis is used for monitoring, then the monitoring is not limited by field of view or lighting, but the position and state of the abnormal situation cannot be precisely determined

Engineering Contradiction:
Improvemonitoring coverageVSAvoidposition and state determination
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent introduces video analysis as an intermediary that complements sound analysis. While sound provides broad coverage without field of view or lighting limitations, video analysis serves as an intermediary to precisely determine the position and state of the abnormal situation. The system uses both modalities together, with video providing the precise spatial and contextual information needed to understand the nature and location of the event.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system transitions from one-dimensional sound detection to two-dimensional video observation. Sound analysis provides detection capability without spatial constraints, while video analysis adds spatial dimensionality, enabling precise determination of position and state. This dimensional transition allows the system to maintain the versatility of sound-based monitoring while achieving the precision of visual observation.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the accurate assessment of the severity of abnormal situations, allowing for timely and appropriate security responses by integrating sound detection with video analysis to analyze crowd reactions.

Implementation Method 1

a sensor configured to detect a sound or heat generated from the monitoring target area

Methodology Applied
Scientific EffectSound wave detection: Sound

Implementation Method 2

a sensor configured to detect a sound or heat generated from the monitoring target area

Methodology Applied
Scientific EffectThermal detection: Thermal Radiation

Data Source

PatentUS20240087328A1Monitoring apparatus, monitoring system, monitoring method, and non-transitory computer-readable medium storing program
Publication Date: 2024.03.14 NEC CORP
  • US20240087328A1 patent drawing
  • US20240087328A1 patent drawing
  • US20240087328A1 patent drawing

AI summary

Provided is a new technique in which the severity of an occurred abnormal situation can be learned. A monitoring apparatus (1) includes: a position acquisition unit (2) configured to acquire an occurrence position of an abnormal situation in a monitoring target area; an analysis unit (3) configured to analyze a state of a crowd around the occurrence position of the abnormal situation based on video data of a camera that images the monitoring target area; and a severity estimation unit (4) configured to estimate a severity of the abnormal situation based on a result of the analysis.