AR/VR Interface Objects With Attitude-Triggered Viewing Modes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for interacting with augmented and virtual reality environments are cumbersome, inefficient, and place a significant cognitive burden on users, requiring multiple inputs and consuming excessive energy, particularly in battery-operated devices.
Innovation Solution
The system includes a computer system with a display generation component, cameras, and an input device, enabling intuitive interactions by adjusting virtual user interface objects based on movement and input device contacts, applying filters to live camera feeds, and providing multiple perspectives within the virtual environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional input methods are used to select and manipulate user interface objects in augmented reality environments, then user interface functionality is achieved, but the number of inputs increases and user cognitive burden increases
Solution Approach 1:
The system automatically identifies user intent by analyzing sequences of inputs and the current state of virtual objects, eliminating the need for users to manually specify each parameter. The system serves itself by interpreting the user's goal from contextual cues and automatically configuring the appropriate parameters, thereby reducing input complexity while maintaining full functionality.
Solution Approach 2:
The system pre-configures parameter selection logic and intent recognition models in advance, so that when user inputs are received, the system can immediately interpret them without requiring multiple sequential selections. This preliminary preparation enables direct mapping from user input to system action, reducing the number of interaction steps required.
2Productivity
If conventional input methods are used to interact with virtual elements, then user interface operations are completed, but the time required increases
Solution Approach 1:
The system continuously monitors user inputs and provides real-time feedback by updating the interpretation of user intent as more data becomes available. This allows the system to rapidly converge on the correct interpretation and execute the appropriate action, significantly reducing interaction time compared to sequential parameter selection methods.
Solution Approach 2:
The system dynamically adjusts its interpretation model based on the current state of virtual objects and the sequence of inputs received. This dynamic adaptation enables the system to optimize parameter selection in real-time, accelerating the interaction process while maintaining accuracy.
3Reliability
If conventional input methods are used for virtual reality interaction, then user interface tasks are accomplished, but energy consumption increases
Solution Approach 1:
The system extracts only the essential parameters needed to fulfill user intent from the full set of available parameters. By identifying and processing only the critical subset of parameters required for each interaction, the system reduces computational load and energy consumption while ensuring reliable task completion.
Solution Approach 2:
The system performs partial parameter selection by focusing only on the necessary parameters for the current interaction context, rather than processing all possible parameters. This selective approach reduces energy consumption while maintaining sufficient accuracy for reliable task completion.
Data Source
AI summary
A computer system displays, in a first viewing mode, a simulated environment that is oriented relative to a physical environment of the computer system. In response to detecting a first change in attitude, the computer system changes an appearance of a first virtual user interface object so as to maintain a fixed spatial relationship between the first virtual user interface object and the physical environment. The computing system detects a gesture. In response to detecting a second change in attitude, in accordance with a determination that the gesture met mode change criteria, the computer system transitions from displaying the simulated environment in the first viewing mode to displaying the simulated environment in a second viewing mode. Displaying the virtual model in the simulated environment in the second viewing mode includes forgoing changing the appearance of the first virtual user interface object to maintain the fixed spatial relationship.