Virtual Object Recentering Using Gaze Feedback in AR/VR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for interacting with augmented and virtual reality environments are cumbersome, inefficient, and place a significant cognitive burden on users, often requiring multiple inputs and leading to errors, which also waste energy in battery-operated devices.
Innovation Solution
Implementing computer systems with improved interfaces that include touch-sensitive displays, eye-tracking, hand-tracking, and tactile output generators to facilitate intuitive interaction, such as through gaze and hand gestures, and dynamically recentering virtual objects based on user viewpoint and attention to reduce input complexity and conserve power.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional input methods are used to interact with virtual objects, then basic functionality is achieved, but user interaction efficiency deteriorates and cognitive burden increases
Solution Approach 1:
The system automatically recenters virtual objects based on detected user attention (gaze tracking) without requiring explicit user commands. The computer system monitors user gaze and autonomously adjusts object positioning, allowing the system to serve itself rather than requiring continuous user input instructions.
Solution Approach 2:
The system provides immediate visual feedback by dynamically adjusting the prominence and centering of virtual objects based on real-time detection of user gaze direction. This closed-loop feedback mechanism allows users to interact more efficiently as the system responds automatically to their attention patterns.
2Reliability
If multiple inputs are required to achieve desired outcomes, then precise control is achieved, but interaction time increases and energy consumption increases
Solution Approach 1:
The system performs preliminary centering actions on virtual objects based on predicted user attention patterns. By proactively positioning objects before the user would need to interact with them, the system reduces the number of corrective inputs required and accelerates interaction flow.
Solution Approach 2:
The computer system autonomously monitors and adjusts virtual object positioning based on detected gaze patterns, eliminating the need for users to provide multiple sequential inputs for centering and positioning tasks.
3Adaptability or versatility
If virtual objects are manually positioned, then placement flexibility is achieved, but operation complexity increases and error rate increases
Solution Approach 1:
The system uses real-time gaze tracking feedback to automatically position and recenter virtual objects, providing users with placement flexibility without requiring complex manual positioning operations. Users simply indicate desired locations through gaze, and the system handles the precise positioning.
Solution Approach 2:
The patent replaces manual mechanical positioning operations with an automated optical tracking system. Instead of requiring users to manually manipulate virtual objects through complex input sequences, the system uses eye-tracking technology to detect intent and automatically performs positioning operations.
4Measurement precision
If continuous processing is performed to maintain virtual object positioning, then positioning accuracy is maintained, but energy consumption increases
Solution Approach 1:
The system performs gaze detection and object recentering operations periodically based on detected changes in user attention or interaction context, rather than continuously. This allows the system to maintain positioning accuracy while reducing processing cycles and energy consumption during stable viewing conditions.
Solution Approach 2:
The computer system autonomously determines when recentering operations are necessary based on detected gaze patterns and interaction state, performing processing only when needed rather than continuously, thereby optimizing the balance between positioning accuracy and energy consumption.
Data Source
AI summary
In some embodiments, a computer system selectively recenters virtual content to a viewpoint of a user, in the presence of physical or virtual obstacles, and/or automatically recenters one or more virtual objects in response to the display generation component changing state, selectively recenters content associated with a communication session between multiple users in response detected user input, changes the visual prominence of content included in virtual objects based on viewpoint and/or based on a detected user attention of a user, modifies visual prominence of one or more virtual objects to resolve apparent obscuring of the one or more virtual objects, modifies visual prominence based on user viewpoint relative to virtual objects, concurrently modifies visual prominence based various types of user interaction, and/or changes an amount of visual impact of an environmental effect in response to detected user input.