Linear Discriminant Embedding for Image Patch Descriptors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image recognition technologies require significant computing resources due to high-dimensional image descriptors and rely on manually tuned filters and transformations, which may not be optimal for image matching tasks.

Innovation Solution

The use of linear discriminant embedding to derive image patch descriptors by maximizing the variance ratio between matching and non-matching patches, with optional power regularization and orthogonality constraints to minimize overfitting and redundancy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If high-dimensional image descriptors are used to represent image patches, then image matching accuracy is improved, but computing resource consumption increases

Engineering Contradiction:
Improveimage matching accuracyVSAvoidcomputing resource consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent extracts only the most discriminative features from high-dimensional image descriptors by identifying and retaining dimensions that maximally distinguish matching from non-matching patches. This extraction process reduces dimensionality while preserving the essential information needed for accurate image matching, thereby lowering computing resource consumption without significantly compromising matching accuracy.

Inventive Principle:
Principle #2Taking out (Extraction)

2Productivity

If manually tuned filters and transformations are used to reduce descriptor dimensions, then processing speed is improved, but matching accuracy deteriorates due to suboptimal parameter selection

Engineering Contradiction:
Improveprocessing speedVSAvoidimage matching accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent employs a feedback mechanism where the system evaluates the performance of different filter and transformation parameters on a training set of image patches. Based on this evaluation feedback, the parameters are automatically adjusted and optimized to maximize matching accuracy. This closed-loop optimization ensures that the manually tuned parameters are not arbitrary but are systematically optimized for the specific image matching task, thereby maintaining high accuracy while achieving processing speed improvements through dimensionality reduction.

Inventive Principle:
Principle #23Feedback

3Productivity

If aggressive dimensionality reduction is applied to decrease computing resources, then processing efficiency is improved, but descriptor discrimination capability deteriorates

Engineering Contradiction:
Improveprocessing efficiencyVSAvoiddescriptor discrimination capability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent systematically varies and optimizes the parameters of filters and transformations to find the optimal balance between dimensionality reduction and discrimination capability. By adjusting parameters such as filter sizes, transformation types, and dimensionality reduction ratios, the system adapts the descriptor representation to maintain sufficient discrimination power even at reduced dimensions. This parameter optimization ensures that processing efficiency is improved without unduly compromising the reliability of descriptor discrimination.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS8023742B2Local image descriptors using linear discriminant embedding
Publication Date: 2011.09.20 MICROSOFT TECHNOLOGY LICENSING LLC
  • US8023742B2 patent drawing
  • US8023742B2 patent drawing
  • US8023742B2 patent drawing

AI summary

To render the comparison of image patches more efficient, the data of an image patch can be projected into a smaller-dimensioned subspace, resulting in a descriptor of the image patch. The projection into the descriptor subspace is known as a linear discriminant embedding, and can be performed with reference to a linear discriminant embedding matrix. The linear discriminant embedding matrix can be constructed from projection vectors that maximize those elements that are shared by matching image patches or that are used to distinguish non-matching image patches, while also minimizing those elements that are common to non-matching image patches or that distinguish matching image patches. The determination of such projection vectors can be limited such that only orthogonal vectors comprise the linear discriminant embedding matrix. The determination of the linear discriminant embedding matrix can likewise be constrained to avoid overfitting to training data.