Sparse Feature Map Generation for Surveillance Scene Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Video surveillance systems face high computational resource demands due to the need for manual analysis of large amounts of video data, leading to labor costs and inefficiencies, particularly in processing static backgrounds and identifying dynamic events.

Innovation Solution

An image processing method that captures changes in a monitored scene and performs sparse feature calculation to obtain a sparse feature map, utilizing event cameras or frame difference processing to focus on dynamic areas, reducing unnecessary data processing and computation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual analysis is used to monitor large amounts of video data, then comprehensive monitoring coverage is achieved, but labor costs increase and inspection efficiency decreases

Engineering Contradiction:
Improveinspection efficiencyVSAvoidlabor cost
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent replaces manual mechanical analysis with an automated image processing system that uses event cameras and sparse convolution neural networks. The system automatically captures changes in monitored scenes, performs sparse feature calculations, and generates feature maps without human intervention, thereby eliminating labor costs while improving inspection efficiency through continuous automated operation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If traditional convolution neural network is used to process surveillance video, then comprehensive feature extraction is achieved, but computing resource consumption becomes massive

Engineering Contradiction:
Improvefeature extraction accuracyVSAvoidcomputing resource consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent extracts only the essential dynamic information from video frames by using event cameras to capture changes and applying sparse convolution operations. Instead of processing entire frames, the system extracts and processes only the sparse regions containing actual changes, significantly reducing computing resource consumption while maintaining feature extraction accuracy for dynamic events.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies different processing strategies to different regions of the video data. Event cameras and sparse convolution operations focus computational resources only on regions where changes occur, rather than uniformly processing the entire frame. This localised approach maintains high feature extraction accuracy for dynamic areas while minimizing unnecessary computation in static regions.

Inventive Principle:
Principle #3Local quality

3Use of energy by moving object

If block-based sparse convolution is used, then some computational reduction is achieved, but overlapping regions create additional computational overhead and blocks with large sparseness are still processed

Engineering Contradiction:
Improvecomputational efficiencyVSAvoidcomputational overhead
Core Design Contradiction:
Use of energy by moving objectVSDevice complexity

Solution Approach 1:

The patent performs preliminary processing by using event cameras to capture changes before convolution operations. This preliminary capture of dynamic information allows the system to identify sparse regions in advance, avoiding the need to process entire blocks and eliminating computational overhead from overlapping regions. The event-based approach pre-filters the data to contain only meaningful changes.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11501536B2Image processing method, an image processing apparatus, and a surveillance system
Publication Date: 2022.11.15 SAMSUNG ELECTRONICS CO LTD
  • US11501536B2 patent drawing
  • US11501536B2 patent drawing
  • US11501536B2 patent drawing

AI summary

An image processing method including: capturing changes in a monitored scene; and performing a sparse feature calculation on the changes in the monitored scene to obtain a sparse feature map.