3D Object Recognition Using Statistical Shape Models

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current face recognition systems face challenges in handling illumination variation and pose variation, especially in uncontrolled environments, leading to inefficiencies and the need for manual intervention.

Innovation Solution

A statistical shape model that uses 2D image projections to infer 3D shape information, which is robust to illumination changes and pose variations, allowing for automatic 3D shape recovery and identification/verification using multi-view training data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If image correlation or comparison methods are used for face recognition, then identification can be performed, but the system becomes sensitive to illumination variation and specular reflections

Engineering Contradiction:
Improveidentification accuracyVSAvoidillumination sensitivity
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent transforms the recognition approach by changing from intensity-based parameters (pixel values affected by illumination) to geometric parameters (3D shape coordinates that are illumination-invariant). The statistical shape model represents faces as 3D point clouds with coordinates (x, y, z) that remain constant regardless of lighting conditions, thereby resolving the illumination sensitivity problem while maintaining identification accuracy

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces the optical/image correlation mechanism with a geometric/statistical mechanism. Instead of comparing image intensities and patterns that are affected by illumination, the system uses 3D geometric feature extraction and statistical shape model matching, which are inherently robust to lighting variations and specular reflections

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If 3D shape recovery methods are used to handle pose variation, then robustness to pose changes is achieved, but computational expense increases significantly

Engineering Contradiction:
Improvepose variation robustnessVSAvoidcomputational expense
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent performs preliminary action by pre-computing and storing statistical shape models that capture the essential 3D variations of faces in the training phase. During recognition, instead of performing expensive real-time 3D reconstruction, the system only needs to match the observed 2D image against the pre-computed statistical models, dramatically reducing computational expense while maintaining pose robustness

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent changes the representation from full 3D geometric models requiring expensive reconstruction to statistical shape parameters that can be efficiently matched. By representing faces as linear combinations of eigenfaces in a reduced-dimensional space defined by the statistical model, the system achieves pose robustness with minimal computational cost during recognition

Inventive Principle:
Principle #35Parameter changes

3Reliability

If manual intervention is used to handle uncontrolled environments, then recognition accuracy can be maintained, but automation is reduced and efficiency decreases

Engineering Contradiction:
Improverecognition accuracyVSAvoidmanual intervention requirement
Core Design Contradiction:
ReliabilityVSExtent of automation

Solution Approach 1:

The patent enables the system to serve itself by automatically adapting to uncontrolled environments through the statistical shape model framework. The model inherently handles variations in illumination, pose, and expression without requiring manual calibration or intervention, achieving both high accuracy and full automation simultaneously

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS9087232B23D object recognition
Publication Date: 2015.07.21 APPLE INC
  • US9087232B2 patent drawing
  • US9087232B2 patent drawing
  • US9087232B2 patent drawing

AI summary

A method, device, system, and computer program for object recognition of a 3D object of a certain object class using a statistical shape model for recovering 3D shapes from a 2D representation of the 3D object and comparing the recovered 3D shape with known 3D to 2D representations of at least one object of the object class.