3D Virtual Object Snapping With Gaze-Based Interaction Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for interacting with virtual and augmented reality environments are cumbersome, inefficient, and create a significant cognitive burden on users, often requiring multiple inputs and providing insufficient feedback, leading to errors and energy waste.
Innovation Solution
The system employs improved user interfaces that reduce the number and complexity of user inputs by using eye-tracking, hand-tracking, and tactile feedback to enhance interaction efficiency, including snapping virtual objects to surfaces and adjusting visual characteristics based on predefined criteria.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional user interfaces are used for virtual and augmented reality environments, then users can interact with virtual objects, but the interaction process becomes cumbersome and creates significant cognitive burden
Solution Approach 1:
The system automatically detects when a user is looking at a virtual object using eye-tracking technology and automatically selects the object for interaction without requiring the user to manually indicate selection. This self-service approach eliminates the need for complex manual selection procedures and reduces cognitive burden by having the system serve itself in the object selection process.
Solution Approach 2:
The patent replaces manual mechanical input methods (such as clicking, tapping, or navigating menus) with automatic detection mechanisms based on eye-tracking and gaze estimation. This substitution eliminates the need for complex manual input sequences and directly translates user attention into interaction commands, significantly simplifying the input process.
2Measurement precision
If multiple inputs are required to achieve desired outcomes, then system control precision is improved, but interaction efficiency decreases and time is wasted
Solution Approach 1:
The system continuously tracks user gaze and pre-determines which virtual object the user is looking at, so that when interaction is initiated, the system already knows the target object. This preliminary action eliminates the need for sequential selection steps and allows for immediate, precise interaction with the correct object, reducing both time and maintaining precision.
Solution Approach 2:
The system provides real-time feedback by detecting and responding to user gaze direction, confirming to the user which object is currently selected and ready for interaction. This feedback mechanism ensures precise control while eliminating the need for multiple trial inputs, as the system continuously adapts to user attention and provides immediate confirmation of the intended target.
3Device complexity
If insufficient feedback is provided during interaction, then system complexity is reduced, but user errors increase and cognitive burden increases
Solution Approach 1:
The system implements feedback by continuously monitoring eye-tracking data and providing real-time information about which virtual object is detected as the interaction target. This feedback loop ensures high interaction accuracy by confirming to the user that the system has correctly identified their intended target, preventing errors without requiring complex additional input mechanisms.
Data Source
AI summary
In some embodiments, a computer system snaps a virtual object to a surface within a three-dimensional environment when one or more criteria are met. In some embodiments, a computer system displays a representation of a respective type of virtual object with one or more values for one or more visual characteristics in a three-dimensional environment.