Image Processing System for Stationary Object Detection Reliability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In video surveillance, dense moving object flows, such as crowds, blend into the background, making it difficult to accurately detect left-behind objects using long-term and short-term background models, resulting in noise and false detection.

Innovation Solution

An image processing system that determines whether a region is stationary by comparing images from different time periods and generates reliability information to exclude regions with low reliability from the detection process, minimizing false detection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If long-term and short-term background models are compared to detect left-behind objects, then detection capability is improved, but false detection increases when dense moving object flows occur

Engineering Contradiction:
Improvedetection capabilityVSAvoidfalse detection rate
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent segments the detection process into two distinct stages: first comparing short-term background models to detect moving objects, then comparing long-term background models to detect left-behind objects. This segmentation allows the system to handle dense moving object flows in the first stage and stationary object detection in the second stage, preventing false detections by processing different object types separately rather than simultaneously

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a moving object detection result as an intermediary element that mediates between the short-term and long-term background model comparisons. By using the moving object detection results to mask or exclude regions with dense moving object flows before performing long-term background model comparison, the system prevents these flowing regions from causing false detections in the left-behind object detection process

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If background models are updated over long time periods, then background accuracy is improved, but moving object flows blend into the background causing noise

Engineering Contradiction:
Improvebackground accuracyVSAvoidmoving object information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent implements dynamic background model updates with different time constants for different detection purposes. The short-term background model uses a faster update rate to track recent scene changes and moving object flows, while the long-term background model uses a slower update rate to maintain accurate stationary background representation. This dynamic updating strategy allows the system to adapt to changing scenes without causing moving objects to permanently blend into the background

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent performs preliminary detection of moving objects using the short-term background model before the long-term background model comparison is performed. This preliminary action identifies regions where moving objects are present, allowing the system to exclude these regions from the long-term background model update process, thereby preventing moving object information from being lost or blended into the long-term background model

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10776931B2Image processing system for detecting stationary state of moving object from image, image processing method, and recording medium
Publication Date: 2020.09.15 NEC CORP
  • US10776931B2 patent drawing
  • US10776931B2 patent drawing
  • US10776931B2 patent drawing

AI summary

In order to detect retention in a preferable manner, an image processing system is provided with: a retention area extraction unit that determines whether an area is a retention area in an image frame of a processing time on the basis of a first image generated from each of image frames taken within a first time width from the processing time and a second image generated from each of image frames taken within a second time width from the processing time which is longer than the first time width; and a reliability calculation unit that generates reliability information relating to the determination of the retention area for each area in the image frames to be processed.