Foreground Extraction Using Segment-Based Gradient Thresholds

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing techniques for foreground extraction in computerized vision and automated video surveillance face challenges in accurately determining thresholds for distinguishing foreground and background pixels, especially under varying illumination conditions and noise, leading to inefficient object detection.

Innovation Solution

A novel method that calculates a foreground detection threshold for different segments of an image based on image gradients and illumination intensity, using an edge density factor and illumination intensity factor to dynamically adjust the threshold for each segment, allowing for more accurate classification of pixels as foreground or background.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a single global threshold is used for foreground detection, then the device complexity is low, but the measurement precision deteriorates under varying illumination conditions

Engineering Contradiction:
Improveforeground detection accuracyVSAvoidthreshold calculation complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The image is divided into multiple segments or regions, and a separate threshold is calculated for each segment based on its local gradient characteristics. This allows the threshold to adapt to local illumination variations while maintaining manageable computational complexity through region-based processing rather than pixel-by-pixel analysis.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different threshold values are applied to different regions of the image based on their local gradient properties. Regions with high gradient variations (likely containing foreground objects) receive different threshold treatment compared to regions with smooth gradients (likely background), thereby improving detection accuracy without uniformly increasing complexity across the entire image.

Inventive Principle:
Principle #3Local quality

2Reliability

If the detection threshold is increased to reduce false positives, then the reliability improves, but the measurement precision deteriorates due to missed detections

Engineering Contradiction:
Improvefalse positive rateVSAvoidforeground detection sensitivity
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The detection threshold is made dynamic and adaptive rather than static. The threshold automatically adjusts based on the local gradient characteristics of each image segment, allowing it to be more sensitive in regions where foreground objects are likely to appear (high gradient areas) and more conservative in background regions, thereby balancing reliability and precision.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The threshold parameter is changed based on the gradient magnitude and variance in different regions. By modifying the threshold value according to local image characteristics, the system achieves both high reliability (by raising thresholds in noisy regions) and high precision (by lowering thresholds in regions where foreground objects are expected).

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentEP2959454B1Method, system and software module for foreground extraction
Publication Date: 2017.03.29 AGENT VIDEO INTELLIGENCE
  • EP2959454B1 patent drawing
  • EP2959454B1 patent drawing
  • EP2959454B1 patent drawing

AI summary

A method is provided, suitable for use in extraction of foreground objects from image stream. The method comprises: providing input image data of a region of interest, providing background model of said region of interest, and utilizing said background model for processing each image of the input image data. The processing comprises: determining a background gradient map for pixels in said background model and an image gradient map for pixels in the image; defining a predetermined number of one or more segments in said image and corresponding one or more segments in the background model; determining, for each image segment, an edge density factor is a first relation between the image and background gradient maps for said segment; and calculating foreground detection threshold based on said certain relation, thereby enabling use of said foreground detection threshold for classifying each pixel in the segment as being a foreground or background pixel.