Virtual Templates for Facial Recognition Adaptation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional facial recognition systems for device authentication often fail to adapt to the user's actual behavior during operation, leading to potential inefficiencies and user experience issues, as the enrollment process typically involves controlled poses and positions that may not reflect how the user interacts with the device in real scenarios.

Innovation Solution

The system generates 'virtual' templates based on the user's behavior during successful facial recognition authentication attempts, which are monitored and potentially added to the template space for future operations, allowing for improved adaptation and performance over time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If the system uses controlled enrollment poses and positions, then the enrollment process is standardized and manageable, but the templates do not reflect actual user behavior during operation

Engineering Contradiction:
Improveenrollment process standardizationVSAvoidadaptation to actual user behavior
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The system dynamically updates templates during operation by capturing images at actual user poses and positions, allowing the template space to adapt from static enrollment data to dynamic real-world usage patterns. This resolves the contradiction by making the system flexible and adaptive while maintaining the initial standardized enrollment process.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses feedback from successful authentication attempts to identify and incorporate new poses and positions into the template space. By monitoring which poses actually work for authentication, the system continuously refines its templates to better reflect actual user behavior, bridging the gap between controlled enrollment and real-world usage.

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If the system generates virtual templates from temporary templates, then adaptation to user behavior improves, but the complexity of template management increases

Engineering Contradiction:
Improveadaptation to user behaviorVSAvoidtemplate space management
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments templates into different categories: enrollment templates, temporary templates, and virtual templates. This segmentation allows for organized management of the template space, where each type serves a specific purpose. Virtual templates are generated only when beneficial, reducing unnecessary complexity while maintaining adaptability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of continuously updating all templates, the system selectively generates virtual templates only when temporary templates demonstrate improved authentication performance. This partial action approach balances adaptability with complexity by applying template updates only where and when they provide value.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If the system monitors and tracks virtual template performance over time, then authentication accuracy improves, but processing overhead increases

Engineering Contradiction:
Improveauthentication accuracyVSAvoidprocessing overhead
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system performs continuous performance monitoring of virtual templates during normal authentication operations, utilizing existing processing cycles rather than adding separate monitoring overhead. By integrating performance tracking into the regular authentication flow, the system maintains accuracy improvements while minimizing additional energy consumption.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS11113510B1Virtual templates for facial recognition
Publication Date: 2021.09.07 APPLE INC
  • US11113510B1 patent drawing
  • US11113510B1 patent drawing
  • US11113510B1 patent drawing

AI summary

When a device is successfully unlock using a facial recognition authentication process, feature vectors generated from images obtained during the facial recognition authentication process may be stored as temporary templates on the device. After a period of time, one of the temporary templates may be selected to be used as a “virtual” template for the device. For example, a median temporary template in the temporary templates may be selected as the virtual template. The performance of the virtual template may then be assessed over time and compared to the performance of templates generated from an enrollment process to determine if and how the virtual template is implemented on the device.