Eyeball-Movement GUI Navigation Using Dynamic Reference Positions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing line-of-sight recognition technologies face challenges in accurately recognizing the point of gaze due to changes in relative positions and orientations between the user and the computer, leading to deviations in pointer placement and difficulty in operating the device.
Innovation Solution
An information processing system that recognizes input direction information through eyeball movement, setting a previously acquired eyeball position as a reference, dynamically updating it based on subsequent positions, and performing processing corresponding to adjacent GUI elements based on the moving direction of the eyeball, without relying on precise gaze detection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If line-of-sight recognition technology is used to detect the point of gaze, then the system can recognize user attention and enable hands-free operation, but the point of gaze detection becomes inaccurate due to changes in relative positions and orientations between the user and the computer
Solution Approach 1:
The patent applies the dynamics principle by making the reference eyeball position movable and updateable rather than fixed. The reference position is dynamically adjusted based on previously acquired eyeball positions, allowing the system to adapt to changes in user position and orientation. This dynamic reference frame compensates for relative position changes between the user and computer, maintaining measurement accuracy while enabling hands-free operation.
2Device complexity
If a fixed reference point is used for gaze detection, then the detection algorithm is simple, but the system cannot adapt to changes in user position and orientation
Solution Approach 1:
The reference eyeball position is transformed from a static fixed point to a dynamic updateable reference. The system periodically updates the reference position based on recently acquired eyeball positions, enabling adaptation to user movement while maintaining algorithmic simplicity through the use of basic position averaging rather than complex calibration procedures.
Solution Approach 2:
The system performs self-calibration by automatically updating its own reference frame based on observed eyeball positions. Instead of requiring external calibration tools or procedures, the system uses its own measurement data to adjust the reference position, making the detection system self-adapting to changes in user position and orientation.
3Measurement precision
If calibration procedures are implemented to eliminate gaze detection deviations, then measurement accuracy improves, but operation becomes inconvenient and time-consuming
Solution Approach 1:
The system eliminates the need for manual calibration by implementing self-updating reference position functionality. The reference eyeball position is automatically adjusted based on observed eyeball movements, allowing the system to maintain high measurement accuracy without requiring user intervention for calibration, thus preserving operational convenience.
Solution Approach 2:
The reference position update operates continuously or periodically in the background without interrupting normal system operation. This continuous self-adjustment ensures sustained measurement accuracy while avoiding discrete calibration interruptions that would inconvenience the user.
4Adaptability or versatility
If the reference eyeball position is frequently updated, then the system adapts quickly to position changes, but the processing load increases
Solution Approach 1:
The reference eyeball position is updated periodically rather than continuously with every measurement. This periodic update approach maintains good adaptability to position changes while significantly reducing the processing load and energy consumption compared to continuous updates, achieving an optimal balance between responsiveness and efficiency.
Data Source
AI summary
An information processing method of recognizing, through use of a computer, input of direction information through eyeball movement of a user and performing processing corresponding to a predetermined GUI element, includes setting a previously acquired eyeball position of the user as a reference eyeball position, setting an eyeball position of the user as an input eyeball position, recognizing the input of the direction information based on a moving direction of an eyeball from the reference eyeball position to the input eyeball position; and performing, based on the recognized input of the direction information, processing corresponding to a second GUI element, which is adjacent to a first GUI element currently in a selected state, and is present in a direction the input of which has been received. The reference eyeball position is dynamically and repeatedly updated based on the acquired eyeball position of the user.