Gaze-Informed Target Manipulation Using Visual Placeholder Stabilization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing gaze-based interaction methods in virtual environments suffer from asynchronous eye movements and jittery gaze signals, making it difficult to accurately select and manipulate small or closely positioned virtual elements.
Innovation Solution
A method and system that utilize gaze-tracking to measure a user's gaze position, select a virtual element, present a visual placeholder at a threshold distance, and use secondary input devices for precise movement and manipulation, combining gaze-informed interactions with manual, voice, or peripheral inputs for enhanced precision.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If gaze tracking is used to select virtual elements, then interaction speed is improved, but selection precision deteriorates due to jittery gaze signals
Solution Approach 1:
The patent introduces a visual placeholder as an intermediary element between the user's gaze and the actual virtual element selection. The placeholder stabilizes the interaction by providing a fixed reference point that follows gaze movements, allowing users to select elements rapidly while maintaining precision through the placeholder's stable position rather than relying directly on jittery gaze coordinates
Solution Approach 2:
The system performs preliminary actions by first presenting the visual placeholder at the gaze location before finalizing the selection. This preliminary placement allows the system to capture the intended target while compensating for subsequent gaze movements, effectively decoupling the selection moment from the actual gaze position at that instant
2Ease of operation
If gaze tracking is used for target manipulation, then interaction intuitiveness is improved, but reliability deteriorates due to asynchronous eye movements
Solution Approach 1:
The patent implements feedback by continuously updating the visual placeholder position based on measured gaze locations. This creates a closed-loop system where the placeholder provides real-time visual feedback about the system's interpretation of user intent, allowing users to verify and adjust their selections even when gaze movements are asynchronous or ambiguous
Solution Approach 2:
The visual placeholder serves as a mediator that bridges the temporal gap between gaze initiation and manual input completion. It maintains a consistent reference frame that survives through asynchronous processing delays, ensuring that the intended target remains identifiable even when eye movements outpace manual confirmation
3Measurement precision
If secondary input devices are used for precise manipulation, then manipulation precision is improved, but device complexity increases
Solution Approach 1:
The patent segments the interaction process into distinct phases: gaze-based selection phase and precision manipulation phase. Each phase uses the most appropriate input modality for its specific requirements, combining the speed of gaze tracking with the precision of secondary devices without requiring both to operate simultaneously, thereby managing complexity through temporal separation
Data Source
Figure 1~2
Figure 3~4
Figure 5~6
AI summary
A method for improving user interaction with a virtual environment includes measuring a first position of the user's gaze relative to a virtual element, selecting the virtual element in the virtual environment at an origin when the user's gaze overlaps the virtual element, measuring a second position of a user's gaze relative to the virtual element, presenting a visual placeholder at a second position of the user's gaze when the second position of the user's gaze is beyond a threshold distance from the origin, and moving the visual placeholder relative to a destination using a secondary input device.