3D UI Focus Navigation Using Gaze-Assisted Region Skipping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for interacting with virtual and augmented reality environments are cumbersome, inefficient, and complex, leading to a significant cognitive burden on users and wasting energy, particularly in battery-operated devices.
Innovation Solution
Implementing a computer system with enhanced input mechanisms that utilize gaze and touch inputs to move focus and drag objects around with increased speed and precision, including gaze-assisted movement of focus indicators and drag operations across regions, and differentiated input methods for various user interface objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional input methods are used to move focus and drag objects in virtual/augmented reality environments, then basic interaction functionality is maintained, but user interaction efficiency is low and cognitive burden is significant
Solution Approach 1:
The patent introduces a cursor as an intermediary element that represents the user's selection focus in the virtual environment. This cursor acts as a mediator between the user's physical actions (controller movements, gestures) and the virtual objects, allowing efficient navigation and interaction without requiring direct manipulation of each object. The cursor can be moved independently and positioned precisely to select and interact with various UI elements, significantly improving interaction efficiency.
Solution Approach 2:
The patent creates a virtual representation (cursor) that copies the user's intent and position in the physical world and maps it to the virtual environment. This cursor copy allows the user to interact with virtual objects indirectly through a representative element, reducing cognitive load by providing a consistent and predictable interaction model across different virtual elements.
2Measurement precision
If extensive input operations are required to move focus and drag objects, then precise control is achieved, but interaction time increases and energy is wasted
Solution Approach 1:
The patent implements preliminary action by allowing the cursor to be moved to the desired position before the actual interaction (selection, dragging) occurs. The system predicts the user's intended target based on cursor movement trajectory and prepares the interaction state in advance. This preliminary positioning and prediction reduces the number of discrete input steps needed, decreasing interaction time while maintaining precision through the cursor's accurate positioning capabilities.
Solution Approach 2:
The patent introduces an additional dimensional layer of interaction by separating the selection/focus mechanism (cursor position in 2D screen space) from the manipulation actions. This dimensional separation allows independent optimization: precise 2D cursor positioning for accurate selection, and then distinct interaction modes for dragging or selecting objects, reducing the total input operations required compared to direct 3D object manipulation.
3Adaptability or versatility
If the system provides consistent input methods for all object types, then interface simplicity is maintained, but adaptability to different object types is limited
Solution Approach 1:
The patent implements dynamic input mechanisms that adapt based on the type of virtual object being interacted with. The system dynamically adjusts the cursor behavior, selection criteria, and interaction modes according to the detected object type (e.g., UI element, 3D object, selectable item). This dynamic adaptation allows a single unified cursor-based interface to handle diverse object types effectively, providing high adaptability without requiring multiple specialized input devices or complex switching mechanisms.
Data Source
AI summary
A computer system displays a user interface that includes a first region and a second region separated by a third region and displays a focus indicator within the first region. In response to detecting an input to move the focus indicator relative to the user interface, the input being associated with movement toward the second region, if the input meets respective criteria based on the movement associated with the input, the computer system moves the focus indicator from the first region to the second region in accordance with the movement associated with the input without displaying the focus indicator in the third region; and, if the input does not meet the respective criteria, the computer system changes an appearance of the focus indicator in accordance with the movement associated with the input while continuing to display at least a portion of the focus indicator within the first region.