Multi-Stage Facial Matching Using Coarse-to-Fine Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Facial recognition systems face challenges in producing accurate and efficient results, especially in resource-constrained applications and when dealing with large datasets, due to the complexity of the data being analyzed.

Innovation Solution

The implementation of multi-stage facial matching techniques, where data is analyzed recursively in a fast-to-slow and coarse-to-fine arrangement, using multiple thresholds to separate matching and non-matching candidates, and employing multi-pass facial match techniques with perturbation methods to improve accuracy and speed.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional facial recognition systems analyze all facial characteristics in detail, then accuracy is improved, but processing speed deteriorates

Engineering Contradiction:
Improvefacial recognition accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

The facial recognition process is divided into multiple stages: a first stage that performs initial matching using a subset of facial characteristics (such as eye region features) to quickly identify candidate matches, and a second stage that performs detailed matching using the complete set of facial characteristics only for candidates from the first stage. This segmentation allows the system to maintain high accuracy while significantly improving processing speed by avoiding exhaustive analysis of all characteristics for all faces.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary matching actions in the first stage by analyzing a subset of facial characteristics to create a shortlist of candidate faces. This preliminary action filters out non-matching faces early, so that the more computationally intensive second stage only needs to analyze the remaining candidates in detail, thus balancing speed and accuracy requirements.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If the system processes a large number of previously obtained images, then comprehensive search is improved, but computational resources deteriorate

Engineering Contradiction:
Improvesearch comprehensivenessVSAvoidcomputational resources
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The system segments the comparison process into two stages: the first stage quickly compares the query face against all previously obtained images using a subset of facial characteristics to identify candidate matches, and the second stage performs detailed comparison only for the small subset of candidates that passed the first stage filter. This segmentation enables comprehensive searching of large image datasets while dramatically reducing the total computational resources required.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The first stage performs preliminary filtering by comparing facial characteristics against a threshold to identify potential matches from the large gallery of previously obtained images. This preliminary action creates a manageable shortlist of candidates, allowing the system to maintain comprehensive search coverage while limiting the computational burden to only the most promising candidates in the second stage.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If multiple facial matchers are used with different precision levels, then matching reliability is improved, but system complexity deteriorates

Engineering Contradiction:
Improvematching reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system segments the matching process into multiple sequential stages using different facial matchers: a first facial matcher that uses a subset of facial characteristics for quick initial matching, and a second facial matcher that uses the complete set of facial characteristics for final verification. Each matcher is optimized for its specific stage, and the sequential structure ensures that only necessary complexity is applied where needed, improving reliability without unnecessarily increasing overall system complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The first facial matcher performs preliminary matching using a subset of facial characteristics to quickly identify candidate faces, establishing a foundation for the second stage. This preliminary action using a simpler matcher reduces the complexity burden on the second matcher, allowing it to focus only on verifying the most promising candidates with complete facial characteristic analysis.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10043061B2Facial matching system
Publication Date: 2018.08.07 IDEMIA IDENTITY & SECURITY USA LLC
  • US10043061B2 patent drawing
  • US10043061B2 patent drawing
  • US10043061B2 patent drawing

AI summary

In some implementations, a computer-implemented method for recognizing facial images may include a multi-stage facial verification process to improve the speed and accuracy of a facial recognition operation. For example, a facial recognition module may include multiple stages where a subset of data is analyzed recursively to improve the speed of the facial recognition processes. The multiple stages may be arranged in a fast-to-slow and coarse-to-fine arrangements such that a match decision may be made at each successive stage.