Eye-Tracking Pointer Control With Off-Screen Gaze Action Areas
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for controlling computers using eye tracking cameras are not compatible with all operating systems, particularly those that prohibit interventions in the graphic user interface through additional software, and lack intuitive operation, leading to potential operating errors.
Innovation Solution
A method that captures gaze positions in both a screen area and action areas outside the screen, generating control commands to position a pointer icon and trigger actions, utilizing an eye tracking camera's firmware to send commands to the computer without requiring additional software installation, and employing action areas as virtual buttons for intuitive interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If additional software is installed to enable eye control with conventional graphic user interfaces, then the functionality is expanded, but compatibility with all operating systems is lost
Solution Approach 1:
The patent extracts the eye tracking functionality from the computer system and places it in the camera device. The camera captures gaze position and transmits control commands directly to the computer, eliminating the need for additional software installation on the computer system. This resolves the compatibility issue while maintaining functionality.
Solution Approach 2:
The camera acts as an intermediary device between the user and the computer. It captures eye movements and converts them into control commands that can be executed by the computer's existing graphic user interface, serving as a bridge that enables eye control without modifying the computer's software architecture.
2Ease of operation
If additional buttons and display elements are superimposed on the graphic user interface, then eye control operation is enabled, but the interface becomes incompatible with operating systems that prohibit software manipulation
Solution Approach 1:
The control interface elements are extracted from the graphic user interface and placed in the camera device. The camera displays action areas that correspond to virtual buttons, and the graphic user interface remains unmodified. This allows eye control operation while maintaining compatibility with operating systems that prohibit software manipulation of the UI.
3Ease of operation
If action areas are placed outside the screen area, then intuitive interaction is improved, but the capture area of the eye tracking camera must be extended
Solution Approach 1:
The patent extends the capture area by utilizing the camera's ability to track eye movements in three-dimensional space rather than being limited to a two-dimensional screen plane. The camera captures gaze positions in front of the user's face, allowing action areas to be positioned outside the physical screen boundaries while maintaining accurate tracking.
Data Source
AI summary
The invention relates to a method for controlling a computer, in particular tablet computer, by means of an eye tracking camera. The invention further relates to a corresponding computer-readable storage medium as well as a corresponding system for carrying out the method.A method for controlling a computer, in particular tablet computer (21), by means of an eye tracking camera (22), wherein the method has the following steps:a) capturing a first gaze position (13) in a screen area (10) by means of the eye tracking camera (22);b) generating a first control command, which prompts the computer to control a pointer icon to a target position, which corresponds to the first gaze position (13);c) capturing a second gaze position (13′) in an action area (11A-G) by means of the eye tracking camera (22), wherein the action area (11A-G) lies outside the screen area (11) and is assigned to an action type; andd) generating a second control command, which prompts the computer to perform an action as a function of the target position and/or the action type.