Augmented Reality Modeling and Annotation with Unified Gestures
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for modeling and annotating physical environments using augmented and/or virtual reality are cumbersome, inefficient, and limited in functionality, often requiring multiple inputs and being restricted to real-time or previously-captured media, with limited views and interactions between virtual and physical objects.
Innovation Solution
Improved computer systems with intuitive user interfaces that reduce the number and complexity of inputs, enabling efficient modeling, measuring, and drawing in augmented and/or virtual reality environments, including touch-sensitive displays and cameras for capturing and displaying physical environments, and allowing for different views, annotations, and interactions between virtual and physical objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional methods of modeling and annotating physical environments using augmented and/or virtual reality are used, then the system can provide modeling and annotation functions, but the methods are cumbersome and require multiple separate inputs to achieve an intended outcome
Solution Approach 1:
The system integrates multiple functions (modeling, measuring, drawing, annotating) into a unified augmented reality interface where a single gesture or input can trigger multiple operations. The wearable device serves as both camera, display, and input controller, eliminating the need for separate tools for each function.
Solution Approach 2:
The system automatically performs tasks that would otherwise require manual intervention. For example, the system automatically captures images, processes measurements, and generates annotations without requiring users to manually activate each function through multiple inputs.
2Productivity
If conventional methods of modeling and annotating physical environments using augmented and/or virtual reality are used, then the system can provide annotation functions, but the methods take longer than necessary, thereby wasting energy
Solution Approach 1:
The system performs preliminary actions by pre-processing data and preparing annotations in advance. The wearable device continuously captures environmental data and pre-computes measurement information, so that when a user requests an annotation, it is already prepared and can be displayed immediately without additional processing time or energy.
3Adaptability or versatility
If conventional methods of modeling and annotating physical environments using augmented and/or virtual reality are used, then the system can provide measurement functions, but the methods are limited in functionality and require previously-captured media
Solution Approach 1:
The system transitions from static, pre-captured media to dynamic, real-time processing. The wearable device continuously captures and processes environmental data in real-time, allowing measurements and annotations to be updated dynamically as the user moves through the physical environment, rather than being limited to fixed, pre-captured images.
Data Source
AI summary
A computer system with a display generation component and one or more input devices displays a representation of a physical object that has a first respective object property and a virtual object that does not spatially overlap with the physical object. The system moves the virtual object based on movement of an input. If the movement of the input corresponds to a request to move the virtual object to a physical space that is not occupied by a physical object, the system moves the virtual object by a first amount. If the movement of the first input corresponds to a request to move the virtual object to a physical space that at least partially overlaps with the first physical object, the system moves the virtual object by a second amount, less than the first amount.