Mobile Screenshot Detection via Camera and Light Sensor Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
There is a need for a method to detect when someone is attempting to take a screenshot of a mobile device display without the owner's knowledge or consent, particularly to protect sensitive information, and to alert the sender of a message if their message is being captured.
Innovation Solution
A computer-implemented method that activates a camera and light sensors on the mobile device to monitor for the presence of camera lenses and changes in ambient light, using image processing and convolutional neural networks to detect potential screenshot attempts and trigger alerts if necessary.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a camera and light sensors are activated to monitor for screenshot attempts, then the ability to detect unauthorized screenshotting is improved, but the device complexity and energy consumption increase
Solution Approach 1:
The system activates the camera and light sensors in advance before any screenshot attempt occurs, continuously monitoring the field of view and ambient light conditions. This preliminary monitoring enables the system to detect screenshot attempts as they begin, rather than reacting after the fact, thereby improving detection reliability without requiring complex real-time processing during the actual screenshot capture moment.
Solution Approach 2:
The patent introduces an intermediary processing system that receives data from the camera and light sensors, analyzes the information, and triggers appropriate responses. This intermediary layer simplifies the overall system architecture by separating the sensing components from the decision-making logic, allowing the camera and sensors to function independently while the processing system coordinates their data to detect screenshot attempts.
2Reliability
If the camera and light sensors continuously monitor for screenshot attempts, then the detection reliability is improved, but the energy consumption increases
Solution Approach 1:
Instead of continuous monitoring, the system employs periodic sampling of the camera and light sensor data at predetermined time intervals. This periodic action maintains detection reliability by capturing sufficient data points to identify screenshot attempts while significantly reducing energy consumption compared to continuous operation. The system can adjust the sampling frequency based on risk assessment and operational context.
Solution Approach 2:
The system uses feedback from the light sensors to dynamically adjust camera operation. When the light sensors detect changes in ambient light conditions that correlate with screenshot attempt patterns, the system activates or intensifies camera monitoring. This feedback mechanism ensures the camera operates only when needed, reducing overall energy consumption while maintaining high detection reliability for actual screenshot attempts.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Effectively prevents unauthorized screenshotting by ceasing the display of sensitive information and alerting the sender when a potential screenshot attempt is detected, enhancing privacy and security in message transmission.
Implementation Method 1
activating a camera located on the second mobile device to capture image data regarding a field of view
Implementation Method 2
activating one or more light sensors located in close proximity to the camera in order to capture data representing an amount of ambient light detected by the one or more light sensors
Data Source
AI summary
A method for sending a message from a first device to a second device includes transmitting the message by the first device, receiving the message by the second device, displaying the message on the second device, activating a camera on the second device to capture image data regarding a field of view of the camera, activating one or more light sensors located close to the camera to capture data regarding an amount of ambient light detected by the light sensors, and monitoring the image data to detect a possible presence of one or more suspected camera lenses within the field of view of the camera. Upon the detection of a possible presence of one or more suspected camera lenses within the field of view of the camera or upon detection of a sudden decrease of the amount of ambient light, displaying of the message on the second device is ceased.