Front Camera Shoulder Surf Detection Privacy
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Identity theft and shoulder surfing pose significant threats, particularly in public spaces where individuals can easily access sensitive information displayed on mobile devices, leading to potential financial and privacy losses.
Innovation Solution
A system utilizing a front-facing camera on computing devices to monitor the background environment for changes, alerting users of potential shoulder surfers by obscuring sensitive information on the screen and employing mechanisms to reduce visibility, such as repositioning input fields or displaying notifications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the device continuously monitors the background environment using a camera, then the detection of shoulder surfing attempts is improved, but the energy consumption and device complexity increase
Solution Approach 1:
The system implements periodic background monitoring by capturing images at predetermined time intervals rather than continuously. The processor compares sequentially captured images to detect changes indicating shoulder surfing attempts, thereby reducing energy consumption while maintaining effective detection capability
Solution Approach 2:
The patent replaces complex continuous video processing with simpler image comparison techniques. By capturing discrete images at intervals and comparing them frame-by-frame, the system achieves reliable detection with lower computational overhead and energy usage compared to continuous real-time video analysis
2Loss of information
If the system obscures sensitive information on the screen when a shoulder surfer is detected, then user privacy is improved, but the ease of operation deteriorates
Solution Approach 1:
The system dynamically adjusts screen visibility based on detected threats. When shoulder surfing is detected, the display transitions to an obscured state; when no threat is present, it returns to normal visibility. This dynamic adaptation allows the system to maintain ease of operation during normal use while protecting privacy when needed
Solution Approach 2:
The system takes preliminary protective action by obscuring sensitive information before actual theft can occur. Upon detecting a shoulder surfer, the system proactively masks the display content, preventing potential information loss while allowing the user to remain aware of their surroundings
3Measurement precision
If the device processes and compares image data to detect background changes, then the detection capability is improved, but the productivity and processing speed may be reduced
Solution Approach 1:
The system extracts only the essential elements needed for detection by comparing sequential images to identify specific changes in the background. By focusing on detecting differences between frames rather than processing complete video streams, the system achieves accurate change detection with reduced processing overhead
Solution Approach 2:
The system performs partial processing by analyzing only the portions of images that contain meaningful changes. By comparing sequentially captured images and focusing on detected differences rather than processing entire frames in full detail, the system maintains high detection accuracy while improving processing efficiency
Data Source
AI summary
The security and privacy of a user is enhanced by distinguishing between potentially sensitive information and non-sensitive information being displayed on a display of a computing device. In an embodiment, potentially sensitive information on a display is identified by parsing information to be displayed. A front-facing camera of the user's computing device is used to monitor the user's background and compare any changes to a threshold amount. In response to a detected change in the background, actions are taken to alert the user or reduce the visibility of identified potentially sensitive information shown on the display screen.


