Pose-Adaptive Facial Recognition via Component Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional facial recognition systems face challenges in accurately matching images due to intrapersonal variations such as different viewing angles, illumination levels, facial expressions, and occlusions, which limit their effectiveness in real-life scenarios.

Innovation Solution

The implementation of a pose-adaptive facial-component-alignment approach that includes landmark detection, pose estimation, and two-layer descriptor compression to normalize and compare facial components across varying conditions, using techniques like geometric rectification, symmetric flipping, and two-layer PCA compression to generate a compact, discriminative descriptor.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional appearance-based facial recognition is used, then the system is simple to implement, but it fails to handle intrapersonal variations such as pose changes, illumination differences, and facial expressions

Engineering Contradiction:
Improvehandling of intrapersonal variationsVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent divides the face into multiple facial components (eyes, eyebrows, nose, mouth, cheeks) and processes each component separately. This segmentation allows the system to handle pose variations and occlusions more effectively by focusing on invariant features of individual components rather than the entire face, thereby improving adaptability while managing complexity through modular processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transforms 2D facial images into 3D-like representations by estimating pose parameters and applying geometric transformations. This dimensional transformation enables the system to compensate for pose variations by mentally rotating and aligning facial components, improving robustness to intrapersonal variations without requiring complex 3D scanning hardware.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If the system processes full-resolution facial images, then recognition accuracy is maintained, but data dimensionality and processing time increase

Engineering Contradiction:
Improverecognition accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent extracts only the essential features from facial images by identifying and processing specific facial components (landmarks, eyes, eyebrows, nose, mouth, cheeks) rather than analyzing the entire image. This selective extraction maintains recognition accuracy by focusing on discriminative features while significantly reducing data dimensionality and processing time.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by processing only the necessary facial components for recognition rather than the entire face. By selectively transforming and comparing key features (eyes, eyebrows, nose, mouth, cheeks) while ignoring less important regions, the system achieves accurate recognition with reduced computational overhead.

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If geometric transformations are applied to normalize pose variations, then pose robustness improves, but computational complexity increases

Engineering Contradiction:
Improvepose robustnessVSAvoidcomputational complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent performs preliminary pose estimation and normalization by detecting facial landmarks and estimating pose parameters before feature extraction and comparison. This preliminary action pre-aligns facial components to a canonical pose, ensuring pose robustness in subsequent recognition steps while reducing the computational complexity of real-time pose correction during matching.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9323980B2Pose-robust recognition
Publication Date: 2016.04.26 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9323980B2 patent drawing
  • US9323980B2 patent drawing
  • US9323980B2 patent drawing

AI summary

Some implementations provide techniques and arrangements to address intrapersonal variations encountered during facial recognition. For example, some implementations transform at least a portion of an image from a first intrapersonal condition to a second intrapersonal condition to enable more accurate comparison with another image. Some implementations may determine a pose category of an input image and may modify at least a portion of the input image to a different pose category of another image for comparing the input image with the other image. Further, some implementations provide for compression of data representing at least a portion of the input image to decrease the dimensionality of the data.