Multi-Modal Biometric Authentication for Virtual Assistants

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing voice-enabled virtual assistants face challenges in securely authenticating users, as voice recognition alone is insufficient to prevent malicious access, limiting secure transactions to public information only.

Innovation Solution

A multi-modal biometric authentication system using both voice and facial recognition, integrated with identity filters to generate unique IDs and validate user identity, ensuring robust authentication and fraud prevention by intercepting and analyzing biometric data from standard device hardware.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If voice recognition alone is used for authentication, then ease of operation is improved, but security is worsened

Engineering Contradiction:
Improveease of operationVSAvoidsecurity
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent combines voice biometrics with facial recognition technology to create a multi-modal authentication system. The identity filter integrates multiple biometric modalities (voice and facial features) to verify user identity, thereby maintaining ease of voice-based operation while significantly improving security through the additional verification layer of facial recognition.

Inventive Principle:
Principle #5Merging (Combining)

2Reliability

If multi-modal biometric authentication is implemented, then security is improved, but device complexity is worsened

Engineering Contradiction:
ImprovesecurityVSAvoiddevice complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent introduces an identity filter as an intermediary component that handles the complexity of multi-modal biometric processing. This filter sits between the user input and the virtual assistant, managing the integration of voice and facial recognition systems, and coordinating the authentication workflow. By centralizing the complex processing logic in this intermediary layer, the patent improves security while isolating the complexity from the core virtual assistant system.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If voice recording playback is allowed, then ease of operation is improved, but fraud prevention is worsened

Engineering Contradiction:
Improveease of operationVSAvoidfraud prevention
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The patent performs preliminary facial recognition verification before allowing the virtual assistant to process voice commands or access sensitive information. By establishing facial identity confirmation in advance, the system prevents fraud from voice recording playback attacks. The facial biometric check serves as a preliminary security barrier that must be satisfied before voice-based operations can proceed, thereby maintaining operational convenience while blocking fraud attempts.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10650824B1Computer systems and methods for securing access to content provided by virtual assistants
Publication Date: 2020.05.12 FMR CORP
  • US10650824B1 patent drawing
  • US10650824B1 patent drawing
  • US10650824B1 patent drawing

AI summary

A computerized method of authenticating a user includes receiving, by a computing device, first biometric data from the user via a first biometric input device; extracting one or more first features from the first biometric data; generating a first vector based on the first features; computing a first similarity score reflecting a geometric distance between the first vector and a first reference vector stored in memory; receiving second biometric data from the user via a second biometric input device; extracting one or more second features from the second biometric data; generating a second vector based on the second features; computing a second similarity score reflecting a geometric distance between the second vector and a second reference vector stored in memory; computing a confidence score based on the first and second similarity scores; and determining a right of the user to access restricted information based on the confidence score.