Context-Inclusive Face Clustering Using 3D Geometric Feature Vectors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing facial recognition technologies are limited in accuracy when identifying individuals across varying images due to factors like lighting, angle, and age changes, and lack scalability for large volumes of image data.

Innovation Solution

The approach involves training models to extract facial features, generating feature vectors, and using contextual information such as annotations, timestamps, and location data to improve similarity determination and clustering, allowing for accurate identification of individuals across multiple images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional facial recognition is used to identify people in images, then identification can be performed, but accuracy deteriorates due to variations in lighting, angle, age, and other factors

Engineering Contradiction:
Improvefacial recognition accuracyVSAvoididentification consistency across varying conditions
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent transforms facial recognition from traditional 2D image comparison to 3D geometric feature analysis. By extracting depth information and creating three-dimensional facial models, the system achieves more robust identification that is invariant to lighting, angle, and age variations. The 3D feature space provides additional dimensional information that traditional 2D approaches cannot capture.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system changes the parameter space from raw pixel values to geometric feature descriptors. By transforming facial images into parameterized geometric models that capture essential structural relationships, the system becomes insensitive to variations in lighting conditions, pose angles, and age-related changes while maintaining identification accuracy.

Inventive Principle:
Principle #35Parameter changes

2Quantity of substance

If facial recognition is applied to large volumes of image data, then comprehensive analysis is possible, but scalability deteriorates due to computational complexity

Engineering Contradiction:
Improvevolume of image data processedVSAvoidprocessing speed at scale
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The patent extracts only the essential geometric features from facial images, separating the critical identification information from the overwhelming majority of non-essential pixel data. This feature extraction approach reduces the data dimensionality from millions of pixels to a manageable set of geometric parameters, enabling scalable processing of large image volumes.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system focuses computational resources on analyzing specific local geometric features of the face (such as landmark points, facial contours, and structural relationships) rather than processing the entire image uniformly. This localized feature analysis approach significantly reduces computational complexity while maintaining identification accuracy.

Inventive Principle:
Principle #3Local quality

3Ease of manufacture

If traditional facial recognition approaches are used, then simple implementation is possible, but accuracy deteriorates for large-scale image analysis

Engineering Contradiction:
Improveimplementation simplicityVSAvoidrecognition accuracy at scale
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent introduces 3D geometric feature models as an intermediary representation between the original 2D facial images and the final identification decision. This intermediary layer transforms complex image analysis into simpler geometric feature comparison, maintaining implementation feasibility while dramatically improving accuracy for large-scale analysis.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11080316B1Context-inclusive face clustering
Publication Date: 2021.08.03 AMAZON TECH INC
  • US11080316B1 patent drawing
  • US11080316B1 patent drawing
  • US11080316B1 patent drawing

AI summary

People represented in multiple images can be recognized using accurate facial similarity metrics, where the accuracy can be further improved using contextual information. A set of models can be trained to process image data, and facial features can be extracted from a face region of an image and passed to the trained models. Resulting feature vectors can be concatenated and the dimensionality reduced to generate a highly accurate feature vector that is representative of the face in the image. The feature vector can be used to locate similar vectors in a multi-dimensional vector space, where similarity can be determined based at least in part upon the distance between the endpoints of those vectors in the vector space. Context information from the image can be used to adjust the similarity determination. Similar vectors can be clustered together such that the faces represented by those images are associated with the same person.