Liveness Detection Network Modality Classification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current liveness detection technologies face challenges in accurately distinguishing between real and fake faces, particularly with varying modalities such as dual-channel and RGB images, due to differences in imaging principles and limited compatibility across modalities.

Innovation Solution

The method involves feature extraction from collected images, modality classification to determine the target modality, and authenticity prediction to assess whether the target object is living, using a liveness detection network trained on sample data sets including images from multiple modalities, such as dual-channel and RGB modalities, to improve detection accuracy and compatibility across different imaging principles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If liveness detection is performed on images from multiple modalities (dual-channel and RGB), then the applicability and compatibility of the detection system is improved, but the device complexity increases due to needing to handle different imaging principles

Engineering Contradiction:
Improvecompatibility across modalitiesVSAvoidcomplexity of handling multiple modalities
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The liveness detection network is designed to handle multiple modalities (dual-channel and RGB images) through a unified architecture. The network accepts images from different imaging principles and processes them through shared feature extraction layers, enabling one system to perform liveness detection across various image types without requiring separate dedicated systems for each modality.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The network dynamically adjusts its processing based on the input modality type. By detecting whether the input is a dual-channel or RGB image, the system modifies its feature extraction and processing parameters accordingly, allowing optimal handling of each modality's specific characteristics while maintaining a single unified detection framework.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If feature extraction and modality classification are performed to improve detection accuracy, then the measurement precision of liveness detection is improved, but the processing time increases

Engineering Contradiction:
Improvedetection accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The liveness detection process is divided into distinct stages: modality classification (determining whether the image is dual-channel or RGB) followed by feature extraction specific to each modality. This segmentation allows the system to first quickly identify the image type and then apply optimized processing paths for each modality, improving overall efficiency while maintaining high accuracy through specialized feature extraction for each type.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11222222B2Methods and apparatuses for liveness detection, electronic devices, and computer readable storage media
Publication Date: 2022.01.11 BEIJING SENSETIME TECH DEV CO LTD
  • US11222222B2 patent drawing
  • US11222222B2 patent drawing
  • US11222222B2 patent drawing

AI summary

The present disclosure relates to methods and apparatuses for liveness detection, electronic devices, and computer readable storage media, improving the accuracy of liveness detection. The method includes: carrying out feature extraction on a collected image to obtain image feature information; determining a modality classification result of the image based on the image feature information, the modality classification result indicating that the image corresponds to a target modality in at least one modality; and determining whether a target object in the image is living based on the modality classification result of the image.