False Face Detection Using Cascading Multi-Sensor Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing face recognition systems are ineffective against sophisticated methods of forging human faces, such as printed photographs, video images, and 3D masks, and often require user cooperation or movement, leading to inconvenience and delays.

Innovation Solution

A computing device with multiple sensors (color, infrared, and depth) analyzes data streams in a cascading series of stages to detect false representations of human faces, including pattern matching, size verification, depth analysis, and texture feature extraction, without requiring user movement, to quickly identify and differentiate between authentic and forged faces.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single data stream is analyzed for face detection, then the system complexity is low, but the detection accuracy against sophisticated spoofing attempts deteriorates

Engineering Contradiction:
Improvesystem complexityVSAvoiddetection accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The system segments the face detection task into multiple independent data streams captured by different sensor types (visible light, infrared, depth). Each sensor captures different characteristics of the candidate face, and the system analyzes each data stream separately through cascading stages before combining results, thereby improving detection accuracy without creating a monolithic complex system

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transitions from analyzing a single two-dimensional image to analyzing multiple three-dimensional data streams from different sensor modalities. By adding depth information, infrared thermal patterns, and visible light textures as additional dimensions, the system can distinguish real faces from spoofing attempts that may appear similar in a single dimension

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If multiple sensors and cascading analysis stages are used, then detection accuracy improves, but processing time increases

Engineering Contradiction:
Improvedetection accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary analysis in early cascading stages using simpler, faster checks on the multiple data streams. Quick filters are applied first to eliminate obvious spoofing attempts, and only candidates that pass these preliminary stages proceed to more computationally intensive later stages, thereby reducing average processing time while maintaining high detection accuracy

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The cascading stage architecture allows the system to skip unnecessary analysis steps. When a spoofing attempt is detected in an early stage, the system immediately terminates analysis and rejects the candidate, skipping all subsequent processing stages. This rushing through of obvious failures significantly reduces processing time for fraudulent attempts while maintaining security

Inventive Principle:
Principle #21Skipping (Rushing through)

3Reliability

If user cooperation and movement are required for detection, then authentication reliability improves, but user convenience deteriorates

Engineering Contradiction:
Improveauthentication reliabilityVSAvoiduser convenience
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system performs self-service authentication by capturing multiple data streams simultaneously without requiring active user participation. The sensors automatically capture visible light, infrared, and depth information of the user's face in a static state, and the cascading analysis stages automatically process this data to verify authenticity, eliminating the need for user cooperation while maintaining high reliability

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system changes the parameters of authentication from dynamic user actions to static multi-modal sensor measurements. Instead of requiring users to perform movements or cooperate actively, the system captures and analyzes multiple physical parameters (visible reflectance, infrared emission, depth geometry) simultaneously, achieving reliable authentication through passive measurement of inherent facial characteristics

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach effectively reduces processing time and user waiting time by identifying a wide variety of spoofing attempts with high accuracy, reducing the burden on users and enhancing security by denying access to false representations.

Implementation Method 1

a first data stream corresponding to a color image of the candidate face, an infrared data stream corresponding to an infrared image of the candidate face, and a second data stream corresponding to depth information of the candidate face

Methodology Applied
Scientific EffectInfrared radiation detection: Infrared Radiation

Implementation Method 2

a second data stream corresponding to depth information of the candidate face

Methodology Applied
Scientific EffectDepth sensing: Time of Flight

Data Source

PatentUS10650226B2False face representation identification
Publication Date: 2020.05.12 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10650226B2 patent drawing
  • US10650226B2 patent drawing
  • US10650226B2 patent drawing

AI summary

Systems and methods for identifying a false representation of a human face are provided. In one example, a method for identifying a false representation of a human face includes receiving one or more data streams captured by one or more sensors sensing a candidate face. In a plurality of stages that each comprises a different analysis, one or more of the data streams are analyzed, and the stages comprise determining whether a plurality of candidate face depth points lies on a single flat plane or a curving plane. Based at least in part on determining that the plurality of candidate face depth points lies on the single flat plane, an indication of the false representation of the human face is outputted.