Dynamic GUI Object Adjustment for Inaccurate Eye Tracking in AR HMDs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Augmented reality (AR) devices with eye tracking capability face inaccuracies due to environmental and user factors, leading to poor user experience as the device fails to recognize user interactions with graphical user interfaces (GUIs) on head-mounted displays (HMDs) when eye tracking is inaccurate.
Innovation Solution
The method involves determining the spatial relationship between a user's interaction point and a GUI object on an HMD, adjusting parameters such as size or location of the GUI object when the relationship does not satisfy a criterion, to ensure accurate interaction detection, even with inaccurate eye tracking.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If eye tracking technology is used for user interaction, then hands-free operation is enabled, but interaction accuracy deteriorates due to environmental and user factors
Solution Approach 1:
The system dynamically changes the size parameter of GUI objects based on detected eye tracking accuracy. When accuracy deteriorates, the system automatically increases the size of interactive elements, making them easier to select despite imprecise tracking. This parameter adaptation resolves the contradiction by maintaining ease of operation while compensating for measurement precision loss.
Solution Approach 2:
The GUI adapts dynamically by adjusting object parameters in real-time based on eye tracking performance. The system monitors interaction success rates and automatically modifies GUI characteristics such as object size and selection thresholds, transforming a static interface into a dynamic one that responds to tracking conditions and maintains usability.
2Measurement precision
If GUI object size is increased to compensate for inaccurate eye tracking, then interaction detection accuracy improves, but display space utilization deteriorates
Solution Approach 1:
The system applies different sizes to different GUI objects based on their individual interaction detection needs. Rather than uniformly increasing all object sizes, the system selectively enlarges only those objects that require larger targets for accurate selection, maintaining compact layout for objects that don't need adjustment and optimizing display space utilization while improving interaction detection where necessary.
Solution Approach 2:
The system dynamically adjusts the size parameter of GUI objects based on detected interaction accuracy requirements. When eye tracking inaccuracy is detected for specific objects, only those objects are enlarged, allowing the system to maintain high interaction detection accuracy while preserving overall display space utilization by avoiding unnecessary enlargement of all elements.
3Reliability
If the selection threshold is reduced to accommodate inaccurate eye tracking, then user interaction success rate improves, but false selection rate increases
Solution Approach 1:
The system dynamically adjusts the selection threshold based on real-time eye tracking accuracy and user interaction patterns. Rather than using a fixed low threshold that would cause false selections, the system adaptively modifies the threshold to be lenient when tracking is poor but strict when tracking is accurate, maintaining high interaction success rates while minimizing false selections through continuous adaptation.
Solution Approach 2:
The system implements feedback mechanisms by monitoring user interaction outcomes and using this information to adjust selection thresholds. When false selections are detected, the system learns and adjusts the threshold accordingly, balancing the need to accommodate inaccurate tracking with the need to prevent false selections through continuous feedback-driven optimization.
Data Source
AI summary
A method, an apparatus, and a computer program product render a graphical user interface (GUI) on an optical see-through head mounted display (HMD). The apparatus obtains a location on the HMD corresponding to a user interaction with a GUI object displayed on the HMD. The GUI object may be an icon on the HMD and the user interaction may be an attempt by the user to select the icon through an eye gaze or gesture. The apparatus determines whether a spatial relationship between the location of user interaction and the GUI object satisfies a criterion, and adjusts a parameter of the GUI object when the criterion is not satisfied. The parameter may be one or more of a size of the GUI object, a size of a boundary associated with the GUI object or a location of the GUI object.