Sparse Polytope Index for Image Retrieval in Surveillance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In video surveillance systems, operators face challenges in aggregating and tracking information from multiple cameras due to the difficulty in differentiating suspicious behaviors and objects, leading to inefficient searches and forensic analysis.

Innovation Solution

The method involves creating a sparse representation index using a multi-dimensional polytope and a clustering index, where features from query images are used to identify vertices and clusters, allowing for efficient retrieval of related images by mapping features to a high-dimensional space and grouping similar images into clusters.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If a tree-based data structure is used to group similar images, then image retrieval speed is improved, but the system becomes ineffective when object appearances are difficult to differentiate

Engineering Contradiction:
Improveimage retrieval speedVSAvoidnode selection accuracy
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The patent transforms the traditional tree-based single-dimension grouping into a multi-dimensional feature space approach. By representing images as points in a high-dimensional space defined by multiple features (color, texture, shape, etc.), the system can differentiate objects that appear similar in traditional grouping methods. This dimensional expansion allows for more nuanced discrimination while maintaining efficient retrieval through geometric operations like polytope vertex identification.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Area of stationary object

If multiple video cameras are deployed to monitor large areas, then coverage is improved, but the operator's ability to aggregate and track information across cameras deteriorates

Engineering Contradiction:
Improvemonitored area coverageVSAvoidinformation aggregation difficulty
Core Design Contradiction:
Area of stationary objectVSEase of operation

Solution Approach 1:

The patent creates a compressed graphical representation (a copy) of the multi-camera surveillance data in the form of a polytope in high-dimensional space. Instead of requiring operators to manually aggregate information from numerous camera feeds, the system generates a mathematical model that captures the essential features and relationships across all cameras. This graphical copy can be efficiently queried and analyzed, making tracking and information aggregation tractable even with large numbers of cameras.

Inventive Principle:
Principle #26Copying

3Reliability

If forensic analysis requires tracking suspicious persons across multiple video streams, then comprehensive analysis is improved, but the time required to sift through streams deteriorates

Engineering Contradiction:
Improveforensic analysis completenessVSAvoidsearch time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent performs preliminary organization of surveillance data by pre-computing the multi-dimensional feature representations and constructing the polytope structure from all available camera data before forensic analysis is needed. This preliminary action creates a ready-to-query graphical model where suspicious activities can be rapidly identified through targeted searches rather than manual sifting. The system pre-processes the data into a form that enables fast querying, so when forensic analysis is required, the comprehensive search can be conducted much more efficiently.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8107740B2Apparatus and method for efficient indexing and querying of images in security systems and other systems
Publication Date: 2012.01.31 HONEYWELL INTERNATIONAL INC
  • US8107740B2 patent drawing
  • US8107740B2 patent drawing
  • US8107740B2 patent drawing

AI summary

A method includes receiving one or more query images and identifying multiple features associated with an object or an activity using the one or more query images. The method also includes accessing a sparse representation index using the identified features. The sparse representation index includes a multi-dimensional polytope having multiple vertices, and the features identify a point in the polytope. The method further includes identifying multiple vertices in the sparse representation index that are associated with the identified point and providing one or more images associated with the identified vertices. In addition, the method includes identifying one or more clusters of features associated with the identified vertices and providing one or more additional images associated with the one or more identified clusters. The one or more clusters may be identified using a clustering index identifying the clusters and features of training images associated with the clusters.