Virtual Object Repositioning With Gaze Feedback in AR/VR Interfaces
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for interacting with augmented and virtual reality environments are cumbersome, inefficient, and create a significant cognitive burden on users, often requiring multiple inputs and leading to errors, which also waste energy in battery-operated devices.
Innovation Solution
Implementing computer systems with improved interfaces that include touch-sensitive displays, eye-tracking, hand-tracking, and tactile output generators to reduce the number and complexity of user inputs, and dynamically recenter virtual objects based on user viewpoint and attention, enhancing interaction efficiency and reducing power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional input methods are used for interacting with virtual objects, then basic functionality is achieved, but user interaction becomes cumbersome and error-prone
Solution Approach 1:
The system provides real-time visual feedback by displaying a movable indicator that shows the target virtual object currently selected by the gaze-based selection mechanism. This feedback loop allows users to verify their selections and adjust their gaze accordingly, reducing errors and improving interaction reliability without requiring multiple input attempts
Solution Approach 2:
The system automatically tracks user gaze and hand movements to determine selection targets, eliminating the need for users to manually navigate through multiple input steps. The automatic target acquisition and selection process reduces cognitive burden and minimizes user errors by letting the system perform the selection work based on natural user behavior
2Productivity
If multiple input steps are required to achieve desired outcomes, then precise control is possible, but interaction time increases and energy is wasted
Solution Approach 1:
The system continuously monitors and tracks user gaze direction and hand position in advance, preparing the selection indicator to follow user intent proactively. This preliminary tracking action eliminates the need for users to perform multiple discrete input steps, as the system is already positioned to detect and respond to selection intent immediately, thereby reducing both interaction time and energy consumption
Solution Approach 2:
The gaze-based selection mechanism operates continuously without requiring users to lift devices, press buttons, or perform repeated gestures. The continuous tracking and automatic selection process maintains useful action throughout the interaction, eliminating idle time and redundant input operations that would waste energy in battery-operated devices
3Measurement precision
If complex manipulation methods are used for virtual objects, then precise positioning is achieved, but cognitive burden increases
Solution Approach 1:
The movable indicator serves as an intermediary element between the user's gaze/hand movements and the virtual object selection. This visual mediator clearly shows which object will be selected, providing precise positioning feedback without requiring users to understand complex coordinate systems or manipulation gestures. The indicator simplifies the interface by making the selection process transparent and intuitive
Data Source
AI summary
In some embodiments, a computer system selectively recenters virtual content to a viewpoint of a user, in the presence of physical or virtual obstacles, and/or automatically recenters one or more virtual objects in response to the display generation component changing state, selectively recenters content associated with a communication session between multiple users in response detected user input, changes the visual prominence of content included in virtual objects based on viewpoint and/or based on a detected user attention of a user, modifies visual prominence of one or more virtual objects to resolve apparent obscuring of the one or more virtual objects, modifies visual prominence based on user viewpoint relative to virtual objects, concurrently modifies visual prominence based various types of user interaction, and/or changes an amount of visual impact of an environmental effect in response to detected user input.