Gaze-Based 3D Object Selection in AR Interfaces
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for interacting with virtual objects in augmented reality environments are cumbersome, inefficient, and place a significant cognitive burden on users, requiring multiple inputs and wasting energy, especially in battery-operated devices.
Innovation Solution
The implementation of improved computer systems with touch-sensitive surfaces and cameras that allow for intuitive interaction with virtual objects by detecting inputs and adjusting display properties, providing visual indications, and using animated calibration objects to enhance user interface efficiency and reduce input complexity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional methods are used to interact with virtual objects in augmented reality environments, then the interaction can be achieved, but the number of inputs required increases and energy consumption increases
Solution Approach 1:
The system automatically detects the user's gaze direction using camera 143 and determines which virtual object is being viewed, eliminating the need for manual selection inputs. The device serves itself by autonomously identifying the target object based on visual attention, thereby reducing both input complexity and energy consumption.
Solution Approach 2:
The patent replaces manual mechanical input methods (touch, clicks, gestures) with a gaze-based selection mechanism. The camera system captures visual information and the processor automatically translates gaze direction into object selection, substituting physical input actions with optical detection and automated processing.
2Ease of operation
If conventional methods are used to interact with virtual objects, then the interaction can be achieved, but the cognitive burden on users increases
Solution Approach 1:
The interface automatically determines user intent through gaze detection rather than requiring users to manually navigate menus or select objects. The system serves itself by interpreting visual attention as selection command, thereby simplifying the user experience and reducing cognitive load.
Solution Approach 2:
The patent extracts the object selection function from manual input operations and transfers it to the automated gaze detection system. By removing the need for explicit selection inputs, the interface complexity is reduced while maintaining full interaction capability.
3Productivity
If conventional methods are used to orient and position virtual objects, then the positioning can be achieved, but the time required increases
Solution Approach 1:
The system performs preliminary actions by pre-calculating and pre-positioning virtual objects based on gaze direction before explicit user confirmation is needed. The camera 143 continuously tracks user attention, allowing the system to prepare object placement in advance, thereby reducing the time required for final positioning operations.
Solution Approach 2:
The gaze detection and object positioning process operates continuously rather than in discrete steps. The camera system continuously monitors user attention, and the processor continuously updates object positioning based on current gaze direction, eliminating delays between separate orientation and positioning actions.
Data Source
AI summary
A computer system with a display and a touch-sensitive surface receives a request to display a first user interface that includes a first item, and, in response to the request, displays the first user interface with a representation of the first item. Depending on whether the first item corresponds to a respective virtual three-dimensional object, the first item is displayed either with a visual indication to indicate that the first item corresponds to a first respective virtual three-dimensional object or without the visual indication. In response to a request to display a second user interface, the second user interface is displayed with a representation of the second item. Depending on whether the second item corresponds to a respective virtual three-dimensional object, the representation of the second item is displayed with or without the visual indication.