Optimal Gradient Pursuit for Facial Image Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image alignment techniques, such as Active Appearance Model (AAM) and Boosted Appearance Model (BAM), face challenges in maintaining alignment accuracy and efficiency when dealing with large datasets and unseen subjects, due to concave score surfaces and divergence issues during optimization.

Innovation Solution

The Optimal Gradient Pursuit Model (OGPM) learns a discriminative alignment score function with minimal angles between gradient directions and ideal travel directions, using a generative shape model and a discriminative appearance model, to improve alignment accuracy and efficiency by minimizing the angle between gradient directions and ideal alignment vectors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If Boosted Ranking Model (BRM) is used to enforce convexity through learning, then alignment reliability is improved, but convergence speed deteriorates due to not directly optimizing gradient directions

Engineering Contradiction:
Improvealignment reliabilityVSAvoidconvergence speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent changes the optimization parameter from indirect ranking loss minimization (BRM) to direct gradient angle minimization (OGPM). By formulating the objective function to directly minimize the angle between gradient directions and ideal alignment vectors, the method achieves both convexity enforcement and faster convergence, resolving the contradiction between reliability and productivity

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces the mechanical ranking-based optimization mechanism (BRM) with a gradient-based directional optimization mechanism (OGPM). This substitution allows the system to directly control the optimization trajectory by aligning gradient directions with ideal alignment vectors, achieving both reliability and efficiency

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If Mean-Square-Error minimization is used in AAM, then alignment accuracy is improved, but computational efficiency deteriorates when trained on large datasets

Engineering Contradiction:
Improvealignment accuracyVSAvoidcomputational efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent replaces the generative Mean-Square-Error minimization mechanism (AAM) with a discriminative gradient-based optimization mechanism (OGPM). This substitution enables the system to achieve high alignment accuracy through direct gradient descent while being computationally efficient on large datasets, as it avoids the iterative generative modeling process

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Device complexity

If gradient direction optimization is not directly performed, then model complexity is reduced, but alignment precision deteriorates due to concave score surfaces

Engineering Contradiction:
Improvemodel complexityVSAvoidalignment precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent changes the optimization approach from indirect score maximization to direct gradient angle minimization. By formulating the objective function to explicitly minimize the angle between gradient directions and ideal alignment vectors, the method ensures alignment precision while maintaining relatively simple model structure, resolving the contradiction between complexity and precision

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS8768100B2Optimal gradient pursuit for image alignment
Publication Date: 2014.07.01 BLUE RIDGE INNOVATIONS LLC
  • US8768100B2 patent drawing
  • US8768100B2 patent drawing
  • US8768100B2 patent drawing

AI summary

A method for image alignment is disclosed. In one embodiment, the method includes acquiring a facial image of a person and using a discriminative face alignment model to fit a generic facial mesh to the facial image to facilitate locating of facial features. The discriminative face alignment model may include a generative shape model component and a discriminative appearance model component. Further, the discriminative appearance model component may have been trained to estimate a score function that minimizes the angle between a gradient direction and a vector pointing toward a ground-truth shape parameter. Additional methods, systems, and articles of manufacture are also disclosed.