Multi-task Deep Neural Network for Liveness Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing biometric analysis systems face challenges in accurately determining user liveliness and authentication, particularly due to sparse or limited training datasets and redundant tasks across different applications, which affect the efficiency and reliability of facial biometric algorithms.

Innovation Solution

A multi-task deep neural network architecture is introduced, featuring a common feature extraction neural network and multiple task-specific neural networks, including face detection, body pose, and liveliness analysis networks, that share results through expert pooling to enhance training and improve liveliness prediction, using convolutional and fully connected layers, and SoftMax functions to optimize loss functions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a single-task biometric analysis system is used, then the system structure is simple, but the accuracy of liveliness detection and authentication is insufficient due to sparse training datasets

Engineering Contradiction:
Improveliveness detection accuracyVSAvoidnetwork architecture complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system divides the biometric analysis into multiple independent task-specific neural networks (liveness detection network, authentication network, face detection network) that each specialize in specific functions. This segmentation allows each network to be optimized for its specific task, improving overall accuracy while maintaining manageable complexity through modular design.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system employs a common feature extraction neural network that serves multiple task-specific networks simultaneously. This multi-functional backbone extracts shared features from input images that can be utilized by different tasks (liveness detection, authentication, face detection), improving accuracy across all tasks while avoiding redundant feature extraction.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If multiple separate biometric analysis systems are implemented for different tasks, then each task can be optimized independently, but redundant computations and tasks across applications reduce efficiency

Engineering Contradiction:
Improvetask-specific analysis accuracyVSAvoidprocessing efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system merges multiple task-specific neural networks into a unified multi-task framework that shares a common feature extraction backbone. This combination allows different biometric analysis tasks (liveness detection, authentication, face detection) to be performed simultaneously with shared computational resources, eliminating redundant computations while maintaining task-specific optimization.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The common feature extraction neural network serves as a universal component that provides features to multiple task-specific networks. This multi-functionality enables the system to perform various biometric analyses using shared features, improving processing efficiency by avoiding repeated feature extraction for each task.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Reliability

If traditional biometric algorithms are used with limited training data, then the implementation is straightforward, but the reliability of authentication and liveness detection is compromised

Engineering Contradiction:
Improveauthentication reliabilityVSAvoidtraining and processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system segments the authentication process into multiple specialized networks (liveness detection, authentication, face detection) that can be trained independently on their respective datasets. This segmentation allows each network to achieve higher reliability through specialized training while the modular structure keeps the overall system complexity manageable.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary feature extraction through the common backbone network before passing features to task-specific networks. This preliminary action prepares optimized features in advance that can be efficiently utilized by multiple tasks, improving both reliability through better feature quality and reducing processing complexity by avoiding redundant operations.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11776323B2Biometric task network
Publication Date: 2023.10.03 FORD GLOBAL TECH LLC
  • US11776323B2 patent drawing
  • US11776323B2 patent drawing
  • US11776323B2 patent drawing

AI summary

A liveliness prediction output is provided from a liveliness biometric analysis task that is determined by a deep neural network based on an image provided from an image sensor wherein the liveliness biometric analysis task is performed in a deep neural network that includes a common feature extraction neural network and a plurality of task-specific neural networks including a face detection neural network, a body pose neural network and a liveliness neural network including a region of interest (ROI) detection neural network and a texture analysis neural network to determine the liveliness biometric analysis task by inputting the image to the common feature extraction neural network to determine latent variables. The latent variables can be input to the face detection neural network and the liveliness neural network. Output from the face detection neural network can be input to the ROI detection neural network.