Hierarchical Visual Pattern Classification via Local Feature Embedding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

As the number of different types of fonts, objects, faces, or scenes to be recognized or classified increases, the ability to recognize or classify a particular visual pattern becomes more difficult and time-consuming, requiring more efficient methods for visual pattern classification.

Innovation Solution

A system and method for generating hierarchical and nonhierarchical visual pattern classes using local feature embedding (LFE) and a recognition machine that employs a nearest class mean classifier with metric learning and max-margin template selection, enabling efficient handling of open-ended image classification problems by generating feature vectors that capture both fine-grained and coarse-grained aspects of visual patterns.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the number of visual pattern types to be recognized increases, then the comprehensiveness of recognition improves, but the recognition time and computational complexity increase

Engineering Contradiction:
Improvecomprehensiveness of recognitionVSAvoidrecognition time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent segments the large number of visual pattern types into hierarchical classes and clusters. Instead of recognizing all patterns simultaneously, the system divides them into parent classes and child classes, allowing progressive recognition from general to specific. This segmentation reduces the computational burden at each stage while maintaining comprehensive recognition capability across all pattern types.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a hierarchical dimension to the recognition structure. By organizing patterns into multiple levels (parent classes, child classes, clusters), the system transforms a flat, single-dimensional recognition problem into a multi-dimensional hierarchical structure. This allows the system to handle increasing numbers of patterns by adding hierarchical depth rather than increasing computational complexity in the original dimension.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If the number of visual pattern types to be recognized increases, then the comprehensiveness of recognition improves, but the computational complexity increases

Engineering Contradiction:
Improvecomprehensiveness of recognitionVSAvoidcomputational complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the computational task into multiple stages corresponding to different hierarchical levels. Each stage handles a subset of patterns at its specific level, dividing the overall computational complexity into manageable chunks. This segmentation allows the system to scale comprehensiveness by adding hierarchical layers rather than increasing complexity linearly.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary actions by pre-organizing visual patterns into hierarchical classes and clusters before recognition. This pre-processing creates a structured framework that simplifies subsequent recognition operations. By establishing the hierarchical structure in advance, the system reduces the computational complexity required during actual recognition, as patterns are already grouped and organized for efficient processing.

Inventive Principle:
Principle #10Preliminary action

3Ease of manufacture

If traditional classification methods are used, then implementation is simple, but error propagation occurs and accuracy decreases

Engineering Contradiction:
Improveease of implementationVSAvoidrecognition accuracy
Core Design Contradiction:
Ease of manufactureVSReliability

Solution Approach 1:

The patent segments the classification process into hierarchical stages with multiple classifiers operating at different levels. Each classifier handles a specific subset of patterns at its level, and errors are contained within local clusters rather than propagating system-wide. This segmented approach maintains implementation simplicity while improving reliability through localized error containment and multiple verification stages.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements feedback mechanisms where classification results from parent classes inform child class classification, and misclassifications are corrected through auxiliary nodes and re-evaluation. This feedback loop allows the system to maintain high accuracy by continuously refining classifications based on results from previous hierarchical levels, while still using relatively simple classifier components at each stage.

Inventive Principle:
Principle #23Feedback

4Adaptability or versatility

If new visual pattern classes are added, then comprehensiveness improves, but computational cost increases

Engineering Contradiction:
Improvecomprehensiveness of recognitionVSAvoidcomputational cost
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent uses a nested hierarchical structure where new pattern classes can be added as child nodes within existing parent classes or as new parent classes at appropriate hierarchical levels. This nesting allows incremental expansion of comprehensiveness without requiring complete reprocessing of all patterns. New classes are integrated into the existing hierarchical framework, minimizing the computational cost of adding comprehensiveness.

Inventive Principle:
Principle #7Nested doll (Nesting)

Solution Approach 2:

The patent performs preliminary organization of patterns into hierarchical classes and clusters before recognition. When new pattern classes are added, they can be pre-integrated into the hierarchical structure, and the pre-computed hierarchical relationships can be leveraged to minimize additional computational cost. This preliminary structuring allows the system to accommodate new classes efficiently without linearly increasing computational requirements.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9524449B2Generation of visual pattern classes for visual pattern recognition
Publication Date: 2016.12.20 ADOBE INC
  • US9524449B2 patent drawing
  • US9524449B2 patent drawing
  • US9524449B2 patent drawing

AI summary

Example systems and methods for classifying visual patterns into a plurality of classes are presented. Using reference visual patterns of known classification, at least one image or visual pattern classifier is generated, which is then employed to classify a plurality of candidate visual patterns of unknown classification. The classification scheme employed may be hierarchical or nonhierarchical. The types of visual patterns may be fonts, human faces, or any other type of visual patterns or images subject to classification.