Multi-Modal Biometric Authentication for Messaging Applications
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current security measures for electronic devices, such as ID and password or PIN, provide limited protection and are inadequate for authenticating users in messaging and virtual assistant applications, which require strong and continuous authentication without additional user actions.
Innovation Solution
A multi-modal biometric authentication system that collects and fuses behavioral, image, and voice data during user interactions in messaging applications, such as typing and voice messaging, to create a biometric score for continuous and frictionless authentication, eliminating the need for additional login processes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional security measures (ID, password, PIN) are used for authentication in messaging applications, then the authentication process is simple to implement, but the security protection is limited and inadequate
Solution Approach 1:
The patent combines multiple biometric modalities (facial recognition, voice recognition, behavioral analysis) into a unified authentication system. The system merges these different authentication methods to work together, creating a multi-layered security approach that significantly improves authentication reliability while maintaining a user-friendly interface through automated operation.
Solution Approach 2:
The authentication system is designed to perform multiple functions simultaneously: it captures facial images, records voice samples, analyzes typing behavior, and synthesizes these data sources into a comprehensive authentication decision. This multi-functional approach allows the system to improve security without requiring separate authentication processes for each biometric modality.
2Measurement precision
If multi-modal biometric authentication is implemented in messaging applications, then authentication accuracy is improved, but the complexity of the authentication process increases
Solution Approach 1:
The system performs authentication automatically without requiring user intervention to select or coordinate different biometric modalities. The system self-manages the collection of facial, voice, and behavioral data, and automatically synthesizes these inputs into an authentication decision, thereby improving accuracy while keeping the user experience simple.
Solution Approach 2:
The system pre-establishes biometric templates during an initial enrollment phase, storing facial features, voice characteristics, and behavioral patterns. During actual authentication, the system only needs to compare new inputs against these pre-created templates, simplifying the real-time authentication process while maintaining high accuracy through multi-modal comparison.
3Reliability
If continuous authentication is performed during user interaction with messaging applications, then security protection is strengthened, but additional user actions are required
Solution Approach 1:
The system performs authentication continuously during normal messaging interactions by automatically analyzing each user action (typing, voice messages, facial expressions) as it occurs. This continuous monitoring provides ongoing security verification without interrupting the user's natural workflow or requiring separate authentication steps.
Solution Approach 2:
The continuous authentication system operates autonomously, automatically collecting and analyzing biometric data from ongoing user interactions without requiring users to initiate or manage the authentication process. The system self-determines when authentication is needed and processes it in the background, maintaining security while preserving ease of operation.
Data Source
AI summary
A user authentication method in a messaging application of an electronic device. The method comprises, if at least one text message is typed by a user in the messaging application, collecting image data relating to said user and behavioral data relating to said user, and, if at least one voice message is pronounced by said user in the messaging application, collecting image data relating to said user and voice data relating to said user. The method also comprises, depending on the type of the message from text messages and voice messages, determining an image recognition score based upon comparison of the collected image data relating to said user and a stored image template data relating to said user obtained during typing or pronouncing a message by said user during a prior session, determining a voice recognition score based upon comparison of the collected voice data relating to said user and a stored voice template data relating to said user obtained during pronouncing a message by said user during a prior session, and determining a behavioral recognition score based upon comparison of the collected behavioral data relating to said user and a stored behavioral template data relating to said user obtained when said user typed the message during a prior session. The method also comprises creating a biometric score by using fusion of the image recognition score and one of the voice recognition score and the behavioral recognition score, and authenticating said user using the biometric score.Present invention allows to authenticate users in messaging applications or virtual assistants during typing and pronunciation of a message with high degree of accuracy.