Gaze-Based Computer Control With Imaging Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing human-computer interaction methods, such as eye and head movement-based cursor control, face precision and fatigue issues, and require significant operating space, leading to inefficient and ergonomically challenging user interfaces.
Innovation Solution
A computer system utilizing an imaging device to register body part movements, generating feedback data based on absolute gaze point positions initially and then relative movements, allowing for precise and flexible control with reduced fatigue and space requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If eye and head movement-based cursor control is used, then the input bandwidth is improved, but measurement precision deteriorates due to tracking errors
Solution Approach 1:
The patent introduces a mechanical input device as an intermediary between the user and the computer system. This mediator allows users to compensate for gaze tracking errors by making fine adjustments with the mechanical device, thereby resolving the precision problem while maintaining the high input bandwidth benefit of gaze-based control.
Solution Approach 2:
The system provides visual feedback by displaying a cursor or indicator that shows the detected gaze position. This feedback loop allows users to see where their gaze is being registered and make real-time corrections, improving measurement precision through user awareness and adjustment.
2Measurement precision
If mechanical input devices are used to compensate for gaze errors, then measurement precision is improved, but ease of operation deteriorates due to fatigue and repetitive strain
Solution Approach 1:
The patent employs partial action by using the mechanical input device only for fine adjustments when needed, rather than requiring continuous mechanical manipulation. The gaze-based control handles the majority of cursor movement, and the mechanical device is used sparingly to correct positioning errors, thereby reducing fatigue while maintaining precision.
3Ease of operation
If gaze-based control is used, then ease of operation is improved, but device complexity increases due to tracking equipment imperfections
Solution Approach 1:
The system allows users to self-correct tracking errors using the mechanical input device. Instead of requiring complex error correction algorithms in the tracking system itself, the user independently compensates for inaccuracies, thereby managing the complexity issue through user action rather than system complexity.
4Measurement precision
If conventional mice are used, then measurement precision is maintained, but ease of operation deteriorates due to required operating space
Solution Approach 1:
The patent replaces the mechanical mouse system with a gaze-based control system. This substitution eliminates the need for physical mouse movement space on the desktop, as gaze control requires only the user's visual attention. The mechanical input device is used minimally for adjustments, further reducing space requirements compared to continuous mouse usage.
Data Source
AI summary
The present invention relates to control of a computer system, which includes a data processing unit, a display and an eye tracker adapted to register a user's gaze point with respect to the display. The data processing unit is adapted to present graphical information on the display, which includes feedback data reflecting the user's commands entered into the unit. The data processing unit is adapted to present the feedback data such that during an initial phase, the feedback data is generated based on an absolute position of the gaze point. An imaging device of the system is also adapted to register image data representing movements of a body part of the user and to forward a representation of the image data to the data processing unit. Hence, during a phase subsequent to the initial phase, the data is instead generated based on the image data.