Eye-Tracking Camera Control Without GUI Modification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for controlling computers using eye-tracking cameras are not compatible with all operating systems, particularly those that prohibit modifications to the graphical user interface, and require additional software to enable intuitive operation and action triggering.
Innovation Solution
A method that captures gaze positions within both a screen area and an action area outside the screen, generating control commands to move a pointer symbol and perform actions without modifying the graphical user interface, using firmware in the eye-tracking camera to send commands to the computer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If additional software is installed to enable intuitive operation and action triggering, then ease of operation is improved, but device complexity increases
Solution Approach 1:
The eye-tracking camera performs self-service by generating and sending control commands autonomously based on detected gaze positions. The camera's processor independently determines when to move the pointer and when to trigger actions, eliminating the need for external software overlays or assistants to mediate between eye tracking and computer control.
Solution Approach 2:
The patent introduces an intermediary mechanism in the form of defined gaze position patterns and temporal logic that translate eye movements into computer commands. Instead of using software overlays as intermediaries, the system uses predefined rules about gaze duration, movement patterns, and position sequences to mediate between the user's eye movements and computer actions.
2Ease of operation
If the graphical user interface is modified by additional software, then ease of operation is improved, but adaptability deteriorates
Solution Approach 1:
The patent extracts the GUI modification function from the software layer and relocates it to the hardware layer (eye-tracking camera). By taking out the need for software overlays and implementing the control logic directly in the camera's processor, the system becomes compatible with operating systems that prohibit GUI modifications.
Solution Approach 2:
Instead of having software modify the GUI to enable eye-tracking control, the patent inverts the approach by having the eye-tracking camera directly generate control commands without any GUI modification. The control logic flows from the camera outward to the computer, rather than from software inward to modify the interface.
3Ease of operation
If action triggering is enabled through software overlays, then ease of operation is improved, but reliability deteriorates
Solution Approach 1:
The patent implements feedback through temporal patterns of gaze positions. The system monitors the sequence and duration of gaze positions, using time-based feedback to distinguish between intentional actions and accidental glances. By requiring specific temporal patterns (e.g., sustained gaze for a threshold period), the system reduces errors while maintaining ease of operation.
Data Source
Figure 1
Figure 2a~2b
Figure 2c~2d
AI summary
The invention relates to a method for controlling a computer, in particular a tablet computer, by means of an eye-tracking camera. The invention further relates to a corresponding computer-readable storage medium and a corresponding system for carrying out the method.Method for controlling a computer, in particular a tablet computer (21), by means of an eye-tracking camera (22), the method comprising the following steps: a) detecting a first gaze position (13) in a screen area (10) by the eye-tracking camera (22); b) generating a first control command that causes the computer to move a pointer symbol to a target position corresponding to the first gaze position (13); c) detecting a second gaze position (13') in an action area (11A-G) by the eye-tracking camera (22), wherein the action area (11A-G) is outside the screen area (11) and is associated with an action type; and d) generating a second control command that causes the computer to perform an action depending on the target position and/or the action type.