Exemplar-Based Object Classification Using Heterogeneous Compositional Features

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for object classification in images, such as 'bag-of-features' representations, are not discriminative enough and struggle with large within-category variations due to pose, aspect, and shape changes, leading to incorrect classification of background features and limited descriptive ability.

Innovation Solution

A method that generates a strong classifier by training weak classifiers on heterogeneous compositional features, using AdaBoost to combine them, and employing SVM to capture spatial relationships and deformations, resulting in a robust object detection system capable of handling various poses and aspects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If bag-of-features representation is used for object classification, then computational simplicity is improved, but discriminative power deteriorates leading to incorrect classification of background features

Engineering Contradiction:
Improvecomputational simplicityVSAvoiddiscriminative power
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent segments the image into superpixels instead of using individual pixels or features. This segmentation creates meaningful visual words that group adjacent pixels with similar properties, providing better discriminative power while maintaining computational efficiency through the bag-of-visual-words framework.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent combines multiple heterogeneous features (color, texture, shape, spatial relationships) into composite superpixels. This composite approach creates more discriminative visual words by integrating information from different feature types, resolving the contradiction between simplicity and discriminative power.

Inventive Principle:
Principle #40Composite materials

2Device complexity

If individual features are used in bag-of-features representation, then model simplicity is improved, but descriptive ability deteriorates due to ignorance of spatial relationships

Engineering Contradiction:
Improvemodel simplicityVSAvoidspatial relationships
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The patent adds spatial dimension to the feature representation by computing spatial relationships between superpixels (e.g., directional histograms, relative positions). This dimensional extension captures spatial information without significantly increasing model complexity, as the spatial relationships are encoded in histogram form similar to the bag-of-visual-words approach.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If constellation models are used to capture spatial relationships, then measurement precision is improved, but device complexity increases due to explicit enumeration of feature matching

Engineering Contradiction:
Improvespatial relationship captureVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical explicit enumeration process of constellation models with a statistical histogram-based approach. Instead of explicitly matching and enumerating feature correspondences, the method uses histogram intersections to measure spatial relationship similarity, dramatically reducing computational complexity while maintaining precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Ease of operation

If bag-of-features representation is used, then ease of operation is improved, but reliability deteriorates when dealing with large within-category variations

Engineering Contradiction:
Improveease of implementationVSAvoidclassification accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent applies local quality by using heterogeneous features with different properties (color, texture, shape, spatial) to represent different aspects of objects. This allows the system to capture within-category variations more effectively, as different features are sensitive to different types of variations, improving reliability while maintaining the simplicity of the bag-of-features framework.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS8233704B2Exemplar-based heterogeneous compositional method for object classification
Publication Date: 2012.07.31 SRI INTERNATIONAL
  • US8233704B2 patent drawing
  • US8233704B2 patent drawing
  • US8233704B2 patent drawing

AI summary

A method for automatically generating a strong classifier for determining whether at least one object is detected in at least one image is disclosed, comprising the steps of: (a) receiving a data set of training images having positive images; (b) randomly selecting a subset of positive images from the training images to create a set of candidate exemplars, wherein said positive images include at least one object of the same type as the object to be detected; (c) training a weak classifier based on at least one of the candidate exemplars, said training being based on at least one comparison of a plurality of heterogeneous compositional features located in the at least one image and corresponding heterogeneous compositional features in the one of set of candidate exemplars; (d) repeating steps (c) for each of the remaining candidate exemplars; and (e) combining the individual classifiers into a strong classifier, wherein the strong classifier is configured to determine the presence or absence in an image of the object to be detected.