Screen Analysis Device Security for Mobile Authentication
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mobile devices are vulnerable to unauthorized access due to the cumbersome nature of existing security measures, such as biometrics and passwords, which may be disabled for convenience.
Innovation Solution
Implementing a classification model that learns the behavior and preferences of the device owner by analyzing content displayed on the screen in trusted environments, allowing the device to detect outlier activity and issue challenges to authenticate the user.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If biometrics and passwords are used to protect access to mobile devices, then security is improved, but user convenience deteriorates
Solution Approach 1:
The system performs preliminary learning of user behavior patterns during trusted sessions before security verification is needed. By pre-collecting and analyzing screen content, location, and usage patterns during normal operation, the system builds a baseline of expected behavior in advance, enabling automatic anomaly detection without requiring user intervention at security checkpoints
Solution Approach 2:
The system enables self-service security by automatically detecting anomalies in device usage patterns and triggering authentication challenges without user initiation. The classification model continuously monitors screen content, location, and interaction patterns, and autonomously determines when security verification is needed based on detected deviations from established user profiles
2Ease of operation
If security measures are made less cumbersome to improve user convenience, then ease of operation is improved, but security reliability deteriorates
Solution Approach 1:
The system replaces mechanical authentication systems (keyboards, biometric sensors) with an information-based detection system that analyzes screen content, location data, and usage patterns. Instead of requiring physical interaction for authentication, the system uses machine learning models to detect behavioral anomalies and trigger appropriate security responses
Solution Approach 2:
The system dynamically adjusts security parameters based on detected anomalies. When unusual patterns are detected, the system changes from a low-intervention state to a high-security state by presenting authentication challenges. The security level is not fixed but adapts based on the confidence score and nature of detected anomalies
3Difficulty of detecting and measuring
If a classification model analyzes screen content to detect outlier activity, then security detection capability is improved, but device complexity increases
Solution Approach 1:
The system uses a universal classification model that analyzes multiple types of data (screen content, location, usage patterns) through a single machine learning framework. The same model serves both to build user profiles during trusted sessions and to detect anomalies during verification, eliminating the need for separate detection systems for different data types
Solution Approach 2:
The system creates simplified representations (feature vectors) of complex screen content and usage patterns. Instead of analyzing raw screen images directly, the system extracts key features and converts them into compact vector representations that can be efficiently processed by the classification model, reducing computational complexity
Data Source
AI summary
Systems and methods are provided for a content-based security for computing devices. An example method includes identifying content rendered by a mobile application, the content being rendered during a session, generating feature vectors from the content and determining that the feature vectors do not match a classification model. The method also includes providing, in response to the determination that the feature vectors do not match the classification model, a challenge configured to authenticate a user of the mobile device. Another example method includes determining a computing device is located at a trusted location, capturing information from a session, the information coming from content rendered by a mobile application during the session, generating feature vectors for the session, and repeating this until a training criteria is met. The method also includes training a classification model using the feature vectors and authenticating a user of the device using the trained classification model.