3D Shared UI Interaction With Visual Lockout Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods and interfaces for interacting with virtual and augmented reality environments are cumbersome, inefficient, and create a significant cognitive burden on users, often requiring multiple inputs and leading to errors, thereby wasting energy and detracting from the user experience.
Innovation Solution
A computer system with improved methods and interfaces that enhance user interaction by providing intuitive feedback, adjusting user interface objects based on user inputs and environmental context, and dynamically changing immersion levels and sensory adjustments based on biometric data, while reducing unnecessary visual clutter and user confusion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional user interfaces for virtual/augmented reality environments are used, then basic interaction functionality is provided, but the interfaces are cumbersome, require multiple inputs, create cognitive burden, and reduce interaction efficiency
Solution Approach 1:
The system automatically detects user intent through gaze tracking and biometric monitoring, eliminating the need for explicit manual inputs. The interface adapts to user needs autonomously by interpreting physiological signals and eye movements, allowing the system to serve itself in understanding user commands without requiring complex control sequences from the user.
Solution Approach 2:
The patent replaces mechanical input methods (buttons, switches, manual controls) with physiological detection mechanisms. Gaze tracking substitutes for manual pointing and selection, while biometric sensors (heart rate, galvanic skin response) substitute for explicit command inputs, creating a more natural and efficient interaction paradigm that reduces cognitive load.
2Productivity
If multiple inputs are required to achieve desired outcomes in virtual/augmented reality environments, then precise control is possible, but the process takes longer than necessary and wastes energy
Solution Approach 1:
The system continuously monitors biometric data and gaze patterns in advance to predict user intent before explicit commands are given. By detecting physiological arousal changes and sustained gaze directions, the system prepares and anticipates user actions, enabling faster response times and eliminating the need for sequential multi-step input processes.
Solution Approach 2:
The system provides real-time feedback by monitoring biometric responses and adjusting the interface accordingly. This continuous feedback loop allows the system to understand user state and adapt interactions dynamically, reducing the number of inputs needed by interpreting physiological signals as implicit commands and confirming actions through biofeedback mechanisms.
3Reliability
If complex manipulation of virtual objects is required, then precise control is achieved, but errors increase and cognitive burden increases
Solution Approach 1:
The patent introduces biometric data and gaze tracking as intermediary layers between the user and the virtual environment. These intermediaries translate complex cognitive intentions into simple physiological signals that the system can interpret, reducing the cognitive burden on users while maintaining interaction accuracy through multiple detection modalities that verify user intent.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A computer system displays a first user interface object with a first appearance at a first position in a first view of a three-dimensional environment that is at least partially shared between a first and second user. While displaying the first user interface object, the computer system detects a first user input by the first user. In response to detecting the first user input: in accordance with a determination that the second user is not currently interacting with the first user interface object, the computer system performs a first operation; and in accordance with a determination that the second user is currently interacting with the first user interface object, the computer system displays a visual indication, that the first user interface object is not available for interaction, including changing an appearance or position of the first user interface object, and forgoes performing the first operation.