Mobile Object Detection with CNN and Multi-Timescale Background Models

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for detecting mobile objects in video surveillance, such as people or vehicles, struggle with accurately identifying stationary objects due to background changes, particularly from illumination fluctuations, leading to erroneous detections.

Innovation Solution

An image processing system that utilizes three background models with different time spans (short-term, intermediate-term, and long-term) and a Convolution Neural Network (CNN) to differentiate between mobile objects and background regions, learning parameters to enhance detection accuracy under changing environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a long-term background model is used to detect stationary objects, then detection capability for stationary objects is improved, but error detection increases due to background changes from illumination fluctuation

Engineering Contradiction:
Improvedetection capability for stationary objectsVSAvoiderror detection rate
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent divides the background model into three distinct time-span models: short-term, intermediate-term, and long-term background models. Each model captures background characteristics at different temporal scales, allowing the system to segment the analysis of stationary objects across multiple time horizons. This segmentation enables the system to distinguish between temporary illumination changes and genuine stationary objects by comparing detections across the different time-span models.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If a short-term background model is used, then error detection is reduced, but stationary objects that stay longer than the time span cannot be detected

Engineering Contradiction:
Improveerror detection rateVSAvoiddetection capability for stationary objects
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent merges the results from three different background models with varying time spans to make the final detection decision. By combining the short-term, intermediate-term, and long-term background models, the system leverages the strengths of each model: the short-term model reduces false alarms from rapid illumination changes, while the long-term model captures stationary objects that persist beyond brief temporal fluctuations. The integration of these models resolves the contradiction between precision and reliability.

Inventive Principle:
Principle #5Merging (Combining)

3Reliability

If the time span for background analysis is increased to detect stationary objects, then detection capability is improved, but influence from external noise such as illumination fluctuation increases

Engineering Contradiction:
Improvedetection capability for stationary objectsVSAvoidinfluence from illumination fluctuation
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent introduces an intermediary mechanism by using the intermediate-term background model as a bridge between the short-term and long-term models. This intermediate model helps filter out the harmful effects of illumination fluctuation that affect the long-term model, while still maintaining the ability to detect stationary objects. The intermediate-term model acts as a mediator that smooths the transition between rapid changes and long-term trends, reducing the influence of external noise.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS12361700B2Image processing and object detecting system, image processing and object detecting method, and program storage medium
Publication Date: 2025.07.15 NEC CORP
  • US12361700B2 patent drawing
  • US12361700B2 patent drawing
  • US12361700B2 patent drawing

AI summary

Provided is an image processing system, an image processing method, and a program for preferably detecting a mobile object. The image processing system includes: an image input unit for receiving an input for some image frames having different times in a plurality of image frames constituting a picture, which is of a pixel on which the mobile object appears or a pixel on which the mobile object does not appear, for selected arbitrary one or more pixels in an image frame at the time of processing; and a mobile object detection model constructing unit for learning a parameter for detecting the mobile object based on the input.