Mobile Display Visibility Control via User Gaze Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for controlling mobile device displays are limited in determining when the device is in use versus when it is idle, leading to potential display shutdown during active use or failure to turn off during inactivity.
Innovation Solution
The method involves using a camera to capture images of the user, determining the point of regard, and controlling the display based on this information to reduce visibility when the user is not actively viewing, incorporating eye and face tracking technologies to adjust the display settings accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Use of energy by moving object
If a predefined time-out period is used to control display shutdown, then the display can be automatically turned off after inactivity to conserve battery power, but the display may be turned off while the user is still viewing it or left on after the user has stopped using the device
Solution Approach 1:
The system uses a camera to capture images of the user and determines the point of regard to provide feedback on whether the user is actually viewing the display. This feedback mechanism allows the display controller to adjust shutdown timing based on real-time user engagement status, resolving the contradiction between power conservation and reliable display control.
Solution Approach 2:
The patent replaces the traditional mechanical timer-based shutdown system with an optical sensing system using a camera to detect user gaze direction. This substitution enables more accurate determination of user engagement, allowing the display to remain on when the user is viewing it and turn off when the user is not, thereby improving both power management and control reliability.
2Ease of operation
If the display remains on to ensure user viewing, then user experience is improved, but battery power is wasted during inactivity
Solution Approach 1:
The system continuously monitors user engagement through camera-based point of regard detection and uses this feedback to dynamically control display power state. When the user is viewing the display, the system maintains display activation to preserve viewing experience. When the user is not viewing, the system shuts down the display to eliminate power waste, thus resolving the contradiction between ease of operation and energy loss.
3Use of energy by moving object
If the display is turned off to save power, then energy efficiency is improved, but security is compromised when the device is left on
Solution Approach 1:
The system uses camera-based detection to monitor whether the user is actually viewing the display and provides feedback to the display controller. When the user is not viewing the display, the system can securely shut it down to prevent unauthorized access, while still maintaining the ability to turn it on when needed, thus resolving the contradiction between power efficiency and security.
Data Source
AI summary
A method and system are provided for controlling the display of an mobile device by: capturing an image using a camera device of the mobile device, the camera device being directed in a same direction as a display of the mobile device, the image comprising one or more subjects (e.g. users or other humans seen in the image); determining a point of regard in the image for at least one of the one or more subjects, the point of regard being indicative of an area on the display at which a gaze of the corresponding subject is directed; determining, based on the point of regard, an instruction for controlling the display; and controlling the display according to the instruction, wherein controlling the display includes reducing visibility of at least one portion of what is displayed on the display.