Front Camera Shoulder Surf Detection Privacy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Identity theft and shoulder surfing pose significant threats, particularly in public spaces where individuals can easily access sensitive information displayed on mobile devices, leading to potential financial and privacy losses.

Innovation Solution

A system utilizing a front-facing camera on computing devices to monitor the background environment for changes, alerting users of potential shoulder surfers by obscuring sensitive information on the screen and employing mechanisms to reduce visibility, such as repositioning input fields or displaying notifications.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the device continuously monitors the background environment using a camera, then the detection of shoulder surfing attempts is improved, but the energy consumption and device complexity increase

Engineering Contradiction:
Improvedetection accuracyVSAvoidenergy consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system implements periodic background monitoring by capturing images at predetermined time intervals rather than continuously. The processor compares sequentially captured images to detect changes indicating shoulder surfing attempts, thereby reducing energy consumption while maintaining effective detection capability

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent replaces complex continuous video processing with simpler image comparison techniques. By capturing discrete images at intervals and comparing them frame-by-frame, the system achieves reliable detection with lower computational overhead and energy usage compared to continuous real-time video analysis

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Loss of information

If the system obscures sensitive information on the screen when a shoulder surfer is detected, then user privacy is improved, but the ease of operation deteriorates

Engineering Contradiction:
Improveinformation privacyVSAvoiduser accessibility
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system dynamically adjusts screen visibility based on detected threats. When shoulder surfing is detected, the display transitions to an obscured state; when no threat is present, it returns to normal visibility. This dynamic adaptation allows the system to maintain ease of operation during normal use while protecting privacy when needed

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system takes preliminary protective action by obscuring sensitive information before actual theft can occur. Upon detecting a shoulder surfer, the system proactively masks the display content, preventing potential information loss while allowing the user to remain aware of their surroundings

Inventive Principle:
Principle #9Preliminary anti-action

3Measurement precision

If the device processes and compares image data to detect background changes, then the detection capability is improved, but the productivity and processing speed may be reduced

Engineering Contradiction:
Improvechange detection accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system extracts only the essential elements needed for detection by comparing sequential images to identify specific changes in the background. By focusing on detecting differences between frames rather than processing complete video streams, the system achieves accurate change detection with reduced processing overhead

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system performs partial processing by analyzing only the portions of images that contain meaningful changes. By comparing sequentially captured images and focusing on detected differences rather than processing entire frames in full detail, the system maintains high detection accuracy while improving processing efficiency

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9600688B2Protecting display of potentially sensitive information
Publication Date: 2017.03.21 LOOKOUT INC
  • US9600688B2 patent drawing
  • US9600688B2 patent drawing
  • US9600688B2 patent drawing

AI summary

The security and privacy of a user is enhanced by distinguishing between potentially sensitive information and non-sensitive information being displayed on a display of a computing device. In an embodiment, potentially sensitive information on a display is identified by parsing information to be displayed. A front-facing camera of the user's computing device is used to monitor the user's background and compare any changes to a threshold amount. In response to a detected change in the background, actions are taken to alert the user or reduce the visibility of identified potentially sensitive information shown on the display screen.