Mobile Display Control via Eye Tracking Gaze Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for controlling mobile device displays are limited in determining when the device is in use versus when it is idle, leading to potential display timeout issues while the user is still engaged or unnecessary power consumption.
Innovation Solution
A method using a camera device to capture images and determine the user's point of regard, allowing for the display to be controlled by reducing or increasing visibility based on whether the user is looking at the screen, thereby turning the display on or off accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If a predefined time-out period is used to control display shutdown, then power consumption is reduced when the device is idle, but the display may be turned off while the user is still viewing it
Solution Approach 1:
The patent replaces the mechanical timer-based timeout system with an optical detection system using a camera to monitor user presence and gaze direction. The camera captures images of the user's eyes and determines point of regard to dynamically control display visibility, substituting the rigid mechanical timeout mechanism with a flexible optical sensing approach that adapts to actual user engagement.
Solution Approach 2:
The system enables the display to automatically adjust its own visibility based on real-time detection of user engagement through eye tracking. The display monitors itself by capturing images of the user's eyes, determining whether the user is looking at the screen, and autonomously controlling its visibility state without requiring external input or predefined timeout settings.
2Reliability
If the display remains on to prevent premature shutdown, then display availability is maintained, but unnecessary power consumption increases
Solution Approach 1:
The patent implements dynamic display control where the display visibility is continuously adjusted based on real-time eye tracking data. Instead of a static timeout setting, the system dynamically changes display state according to the user's actual viewing behavior, making the display available when needed and turning it off when not in use, thereby optimizing both availability and power consumption.
Solution Approach 2:
The system employs periodic capture of eye images at predetermined time intervals to continuously monitor user engagement. This periodic detection allows the display to be controlled in discrete steps based on updated gaze information, enabling the display to remain on during active viewing periods and turn off during idle periods, thus managing power consumption while maintaining availability.
3Loss of energy
If eye tracking is used to control display visibility, then power consumption is optimized and security is enhanced, but device complexity increases
Solution Approach 1:
The patent leverages the existing camera device already present in the mobile device for photography and video functions, repurposing it for eye tracking and display control. This multi-functional use of the camera eliminates the need for separate eye-tracking hardware, reducing overall device complexity while achieving power optimization and security benefits through software-based gaze detection.
Solution Approach 2:
The system introduces image processing algorithms and point of regard determination software as intermediaries between the camera capture and display control. These software layers process the captured eye images to determine gaze direction and translate it into display visibility commands, acting as mediators that bridge the optical sensing and display control functions without requiring direct hardware integration.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Effectively manages display visibility to conserve battery power and enhance security by ensuring the display is only active when the user is engaged, reducing unnecessary power consumption and protecting sensitive information.
Implementation Method 1
capturing an image using a camera device of the mobile device, the camera device being directed in a same direction as a display of the mobile device, the image comprising one or more subjects; determining a first point of regard in the image for at least one of the one or more subjects
Data Source
Figure 1
Figure 2~3
Figure 4
AI summary
A method and system are provided for controlling the display (110) of a mobile device by: capturing an image using a camera device (123) of the mobile device, the camera device being directed in a same direction as a display of the mobile device, the image comprising one or more subjects (e.g. users or other humans seen in the image); determining a point of regard in the image for at least one of the one or more subjects, the point of regard being indicative of an area on the display at which a gaze of the corresponding subject is directed; determining, based on the point of regard, an instruction for controlling the display; and controlling the display according to the instruction, wherein controlling the display includes reducing visibility of at least one portion of what is displayed on the display.